REPORT  DOCUMENTATION  PAGE 


2 


Form  Approved  OMB  NO.  0704-0188 


The  public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions, 
searching  existing  data  sources,  gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments 
regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information,  including  suggesstions  for  reducing  this  burden,  to  Washington 
Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington  VA,  22202-4302. 
Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  any  oenalty  for  failing  to  comply  with  a  collection 
of  information  if  it  does  not  display  a  currently  valid  OMB  control  number. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 


1 .  REPORT  DATE  (DD-MM-YYYY)  2.  REPORT  TYPE 

Technical  Report 


4.  TITLE  AND  SUBTITLE  5a.  CONTRACT  NUMBER 

Characterization  of  stationary  distributions  of  reflected  diffusions  W91  INF-12-1-0222 

5b.  GRANT  NUMBER 


3.  DATES  COVERED  (From  -  To) 


6.  AUTHORS 

Weining  Kang,  Kavita  Ramanan 


5c.  PROGRAM  ELEMENT  NUMBER 
611102 


5d.  PROJECT  NUMBER 


5e.  TASK  NUMBER 


5f.  WORK  UNIT  NUMBER 


7.  PERFORMING  ORGANIZATION  NAMES  AND  ADDRESSES 

Brown  University 
Box  1929 


8.  PERFORMING  ORGANIZATION  REPORT 
NUMBER 


Providence,  RI  02912  -9093 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS 
(ES) 

U.S.  Army  Research  Office 
P.O.Box  12211 

Research  Triangle  Park,  NC  27709-2211 


10.  SPONSOR/MONITOR'S  ACRONYM(S) 
ARO 


11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

61759-MA.12 


12.  DISTRIBUTION  AVA1LIBILITY  STATEMENT 
Approved  for  public  release;  distribution  is  unlimited. 


13.  SUPPLEMENTARY  NOTES 

The  views,  opinions  and/or  findings  contained  in  this  report  are  those  of  the  author(s)  and  should  not  contrued  as  an  official  Department 
of  the  Army  position,  policy  or  decision,  unless  so  designated  by  other  documentation. 


14.  ABSTRACT 

Given  a  domain  G,  a  reflection  vector  field  d(.  r)  on  \partial  G  ,  the  boundary  of  G,  and  drift  and  dispersion  coe.fi 
cients  b(.  r)  and  \sigma  G  p),  let  L  be  the  usual  second-order  elliptic  operator  associated  with  b(.  r)  and  \sigma  <-(•  r 
).  Under  mild  assumptions  on  the  coe^cients  and  reflection  vector  field,  it  is  shown  that  when  the  associated 
submartingale  problem  is  well  posed,  a  probability  measure  |-  \pi  on  \bar{yG}  with  \pi(  \partial  |-G)  =  0  is  a 
stationary  distribution  for  the  corresponding  reflected  difusion  if  and  only  if 


15.  SUBJECT  TERMS 

reflected  diffusions,  invariant  distribution,  stationary  density,  submartingale  problem,  stochastic  differntial  equatinos  with  reflection; 
basic  adjoint  reelation  (BAR);  adjoint  partial  differential  equations;  skew-symmetry  conditin;  product-form  soluitons;  skew- 


Paul  Dupuis 


19b.  TELEPHONE  NUMBER 
401-863-3238 


Standard  Fonn  298  (Rev  8/98) 
Prescribed  by  ANSI  Std.  Z39.18 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 

15.  NUMBER 

a.  REPORT 

b.  ABSTRACT 

c.  THIS  PAGE 

ABSTRACT 

OF  PAGES 

UU 

UU 

UU 

UU 

Report  Title 

Characterization  of  stationary  distributions  of  reflected  diffusions 

ABSTRACT 

Given  a  domain  G,  a  reflection  vector  field  d(.  r)  on  \partial  G  ,  the  boundary  of  G,  and  drift  and  dispersion  coe/fcients 
b(.  r)  and  \sigma  <-(  r.),  let  L  be  the  usual  second-order  elliptic  operator  associated  with  b(.  r)  and  \sigma  <-(.  r).  Under 
mild  assumptions  on  the  coe/3cients  and  reflection  vector  field,  it  is  shown  that  when  the  associated  submartingale 
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dition,  it  is  shown  that  any  nonnegative  solution  to  a  certain  adjoint  partial  differential  equation  with  boundary 
conditions  is  an  invariant  density  for  the  reflected  dffusion.  As  a  corollary,  for  bounded 
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distribution.  This  boundary  property  is  of  independent  interest. 
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CHARACTERIZATION  OF  STATIONARY  DISTRIBUTIONS 
OF  REFLECTED  DIFFUSIONS 
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Given  a  domain  G,  a  reflection  vector  field  d(-)  on  dG,  the  bound¬ 
ary  of  G,  and  drift  and  dispersion  coefficients  &(•)  and  cr(-),  let  C  be 
the  usual  second-order  elliptic  operator  associated  with  &(•)  and  cr(-). 
Under  mild  assumptions  on  the  coefficients  and  reflection  vector  field, 
it  is  shown  that  when  the  associated  submartingale  problem  is  well 
posed,  a  probability  measure  n  on  G  with  n(dG)  =  0  is  a  stationary 
distribution  for  the  corresponding  reflected  diffusion  if  and  only  if 


Cf(x)n(dx)  <  0 


for  every  /  in  a  certain  class  of  test  functions.  The  assumptions  are 
verified  for  a  large  class  of  obliquely  reflected  diffusions  in  piecewise 
smooth  domains,  including  those  that  are  not  semimartingales.  In  ad¬ 
dition,  it  is  shown  that  any  nonnegative  solution  to  a  certain  adjoint 
partial  differential  equation  with  boundary  conditions  is  an  invari¬ 
ant  density  for  the  reflected  diffusion.  As  a  corollary,  for  bounded 
smooth  domains  and  a  class  of  polyhedral  domains  that  satisfy  a 
skew-symmetry  condition,  it  is  shown  that  if  a  certain  skew-transform 
of  the  drift  is  conservative  and  of  class  C] ,  and  the  covariance  matrix 
is  non-degenerate,  then  the  corresponding  reflected  diffusion  has  an 
invariant  density  p  of  Gibbs  form,  that  is,  p(x )  =  for  some  C2 

function  H.  Finally,  under  a  non-degeneracy  condition  on  the  diffu¬ 
sion  coefficient,  a  boundary  property  is  established  that  implies  that 
the  condition  n(dG)  =  0  is  necessary  for  n  to  be  a  stationary  distri¬ 
bution.  This  boundary  property  is  of  independent  interest. 
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1.  Introduction. 

1.1.  Description  of  Main  Results.  This  work  establishes  a  simple  charac¬ 
terization  of  stationary  distributions  of  a  broad  class  of  reflected  diffusions  in 
piecewise  smooth  domains  with  oblique  reflection,  including  those  that  are 
not  necessarily  semimartingales,  and  uses  it  to  identify  classes  of  reflected 
diffusions  with  state-dependent  drift  for  which  the  stationary  density  takes 
an  explicit  form.  Reflected  diffusions  arise  in  a  variety  of  applications,  rang¬ 
ing  from  queueing  theory  and  operations  research  to  finance  and  mathemat¬ 
ical  physics,  and  their  stationary  distributions  often  serve  to  characterize  or 
approximate  important  quantities  of  interest.  Consider  a  domain  G  C  RJ, 
equipped  with  a  vector  field  d(-)  on  the  boundary  dG,  and  drift  and  dis¬ 
persion  coefficients  b  :  G  H >  and  a  :  G  H >  x  M.N ,  where  G  is  the 
closure  of  G.  A  reflected  diffusion  associated  with  &(•)  and  a(-)  is, 

roughly  speaking,  a  continuous  Markov  process  that  behaves  locally,  near 
x  G  G ,  like  a  diffusion  with  state-dependent  drift  b(x)  and  dispersion  a(x), 
and  is  constrained  to  stay  inside  G  by  a  pushing  term  that  is  only  allowed 
to  act  when  the  process  is  on  the  boundary,  and  then  only  along  the  di¬ 
rections  specified  by  the  vector  field  d(-)  at  that  point  on  the  boundary. 
One  approach  to  making  this  heuristic  description  precise  is  a  generaliza¬ 
tion  of  the  martingale  problem  referred  to  as  the  submartingale  problem, 
which  was  introduced  by  Stroock  and  Varadhan  [43]  to  characterize  the  law 
of  reflected  diffusions  in  smooth  domains.  Other  approaches  to  construct¬ 
ing  reflected  diffusions  include  Dirichlet  forms  [8,  20],  controlled  martingale 
problems  [30]  and  stochastic  differential  equations  with  reflection  (SDER) 
defined  via  the  Skorokhod  problem  [16,  26,  35].  However,  Dirichlet  forms 
are  more  naturally  suited  to  analyzing  normally  reflected  diffusions  (which 
are  symmetric  Markov  processes),  and  the  controlled  martingale  problem 
and  Skorokhod  problem  approaches  can  be  used  only  to  construct  semi¬ 
martingale  reflected  diffusions.  While  extensions  of  these  approaches  have 
been  considered  in  particular  cases  [15,  26,  35],  the  submartingale  problem 
seems  most  suitable  for  providing  a  common  framework  for  the  characteriza- 
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tion  of  the  distributions  of  semimartingale  and  non-semimartingale  reflected 
diffusions  with  oblique  reflection  in  piecewise  smooth  domains. 

fWe  provide  a  precise  formulation  of  the  submartingale  problem  in  piece- 
wise  smooth  domains  in  Definition  2.1.  Prior  to  this  work,  although  the 
submartingale  problem  framework  had  been  used  to  study  specific  exam¬ 
ples  such  as  reflected  Brownian  motion  (RBM)  in  two-dimensional  cusps 
and  wedges,  conical  domains  and  skew-symmetric  RBMs  in  polyhedral  do¬ 
mains  (which  almost  surely  do  not  visit  the  non-smooth  parts  of  the  domain) 
[12,  13,  46,  31,  49],  there  was  no  clear  definition  for  the  submartingale  prob¬ 
lem  in  general  piecewise  smooth  domains.  Indeed,  the  development  of  a 
theory  of  reflected  diffusions  that  could  fail  to  be  semimartingales  in  dimen¬ 
sions  greater  than  two  has  long  been  posed  as  a  challenging  open  problem 
(see  (iii)  in  Section  4  of  [50]).  One  of  the  contributions  of  this  work  is  the 
identification  of  a  suitable  formulation  of  the  submartingale  problem  that 
allows  for  the  unique  characterization  of  both  the  reflected  process  and  its 
stationary  distribution  in  some  generality  (see  Remark  2.4  for  a  discussion 
of  some  of  the  subtleties  involved).  Further  justification  for  the  definition 
of  the  submartingale  problem  that  we  introduce  is  provided  in  [28],  where 
it  is  shown  that  well-posedness  of  the  submartingale  problem  is  equivalent 
to  existence  and  uniqueness  in  law  of  a  weak  solution  to  the  correspond¬ 
ing  SDER,  thus  generalizing  a  classical  result  for  (unconstrained)  diffusions 
obtained  by  Stroock  and  Varadhan  (cf.  Corollary  3.1  of  [42]).  If  the  sub¬ 
martingale  problem  has  a  unique  solutio,  it  is  said  to  be  well-posed. 

For  a  reflected  diffusion  in  a  bounded  domain,  the  family  of  time-averaged 
occupation  measures  is  automatically  tight,  and  existence  of  a  stationary  dis¬ 
tribution  can  be  deduced  as  a  simple  consequence.  On  the  other  hand,  for 
reflected  diffusions  in  unbounded  domains  suitable  conditions  on  the  drift 
and  reflection  vector  field  need  to  be  imposed  to  guarantee  positive  recur¬ 
rence,  and  have  been  identified  in  various  cases  (see,  e.g.,  [1,  24]).  In  either 
case,  when  the  diffusion  coefficient  is  uniformly  elliptic,  uniqueness  of  the 
stationary  distribution  follows  from  standard  results  in  ergodic  theory.  Ex¬ 
plicit  expressions  for  the  stationary  distribution  have  been  obtained  mostly 
for  reflected  Brownian  motions  (RBMs)  with  constant  drift  in  polyhedral 
domains,  either  in  two  dimensions  [14,  48]  or  when  a  special  skew-symmetry 
condition  is  satisfied  [49,  23].  The  focus  of  the  present  paper  is  on  char¬ 
acterization  of  the  stationary  distribution  for  a  general  class  of  reflected 
diffusions  and  the  identification  of  general  classes  of  reflected  diffusions  with 
state-dependent  drift  whose  stationary  densities  are  of  Gibbs  form  or,  equiv¬ 
alently,  strictly  positive. 

Given  continuous  drift  and  dispersion  coefficients  b  :  G  e- )•  R^  and  cr  : 


7 


4  W.  N.  KANG  AND  K.  RAMANAN 

G  i — y  WJxN ,  let  a  :  G  H >  W.JxJ  be  the  associated  diffusion  coefficient  given 
by  a(-)  =  where  crT(x)  denotes  the  transpose  of  the  matrix  a(x ), 

and  let  C  be  the  associated  second-order  differential  operator  given  by 

(1)  Cf(x)  =  +  U'li(x)  f^Cb(G), 

i=  1  1  i,j= 1  %  ^ 

where  C^(G)  is  the  space  of  twice  continuously  differentiable  functions  on  G 
that,  along  with  their  first  and  second  partial  derivatives,  are  bounded.  The 
first  main  result  of  this  paper,  Theorem  1,  shows  that  under  some  analytical 
conditions  (see  Assumption  1),  a  probability  measure  ir  on  G  is  a  stationary 
distribution  for  a  reflected  diffusion  defined  by  a  well-posed  submartingale 
problem  if  and  only  if  ir  satisfies  ir(dG)  =  0  and 

(2)  f  Cf(x)  dir(x)  <  0 

Jg 

for  all  /  belonging  to  7i,  a  certain  class  of  test  functions  defined  in  (3). 
A  subtlety  in  this  result  lies  in  the  correct  choice  of  test  functions  in  (2). 
See  Remarks  2.4  and  5.2  for  further  discussion  of  this  issue.  The  second 
result,  Theorem  2,  shows  that  the  conditions  of  Theorem  1  are  satisfied  by  a 
large  class  of  reflected  diffusions  in  piecewise  smooth  domains  described  in 
Definition  3.3  that  satisfy  a  mild  condition  (Assumption  2).  In  particular, 
this  condition  is  satisfied  whenever  the  so-called  generalized  completely-5 
condition  holds,  which  corresponds  to  the  case  when  the  set  U  defined  in  (6) 
coincides  with  the  boundary  dG.  Illustrative  examples  of  reflected  diffusions 
that  arise  in  applications  and  satisfy  the  assumptions  of  Theorems  2  and  1 
are  presented  in  Section  4. 

The  third  result  (Theorem  3)  shows  that  any  nonnegative  C 2  solution  to 
a  certain  adjoint  partial  differential  equation  (PDE)  with  oblique  derivative 
boundary  conditions,  is  an  invariant  density  for  the  corresponding  reflected 
diffusion.  In  Corollary  1,  this  PDE  is  used  to  identify  a  broad  class  of  RBMs 
with  state-dependent  drift  that  have  an  invariant  density  of  Gibbs  form, 
that  is,  p(x )  =  eH(x^  for  some  C2  function  or  “potential”  H.  In  particular, 
for  bounded  smooth  domains  and  a  class  of  polyhedral  domains  that  satisfy 
a  skew-symmetry  condition,  it  is  shown  in  Corollary  2  that  given  a  non¬ 
degenerate  covariance  matrix  A,  if  a  certain  skew-transform  of  the  drift  is 
conservative  (i.e.,  of  gradient  form)  and  C1,  then  the  reflected  diffusion  has 
an  invariant  density  p  of  Gibbs  form,  that  is,  p(x)  =  eH ^  for  a  suitable 
“potential”  function  H.  In  addition,  it  is  also  shown  that,  under  the  same 
skew-symmetry  condition,  any  RBM  with  such  a  drift  b  and  covariance  ma¬ 
trix  A  is  dual  (with  respect  to  the  invariant  density  p(x)dx)  to  an  RBM  with 
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covariance  A,  drift  —b+AH  and  certain  adjoint  directions  of  reflection.  This 
generalizes  both  the  well  known  property  that  an  (unconstrained)  diffusion 
with  constant  covariance  and  drift  of  gradient  form  has  an  invariant  den¬ 
sity  of  Gibbs  form,  as  well  as  results  in  [23]  for  reflected  Brownian  motions 
with  constant  drift.  We  emphasize  that  in  the  case  of  reflected  diffusions, 
the  gradient  condition  is  on  the  so-called  skew-transform  (see  Definition  3.5) 
of  the  drift,  and  not  on  the  drift  itself.  Furthermore,  several  examples  are 
provided  when  the  potential  H  of  the  stationary  density  takes  an  explicit 
form,  including  the  case  of  reflected  Ornstein-Uhlenbeck  processes,  which 
are  of  interest  in  applications  [38] . 

Finally,  under  a  non- degeneracy  condition  on  the  diffusion  coefficient,  the 
last  result  of  this  paper  (Proposition  6.1)  establishes  a  certain  boundary 
property  which  shows  that  the  reflected  diffusion  spends  almost  surely  zero 
Lebesgue  time  on  the  boundary.  This  boundary  property,  which  is  of  inde¬ 
pendent  interest,  implies  that  ir(dG)  =  0  is  a  necessary  condition  for  n  to 
be  a  stationary  distribution.  It  is  also  used  in  [28]  to  establish  the  equiva¬ 
lence  between  well-posedness  of  submartingale  problems  and  well-posedness 
of  weak  solutions  to  corresponding  SDERs. 

1.2.  Relation  to  Prior  Work.  A  criterion  for  invariant  measures  analo¬ 
gous  to  (2)  was  first  obtained  by  Echeverria  for  (unconstrained)  diffusions 
on  a  locally  compact  separable  metric  space  E  [19].  It  follows  from  Echever- 
ria’s  work  that,  given  drift  and  dispersion  coefficients  b{- )  and  <t(-)  that  are 
associated  with  a  well-posed  martingale  problem,  a  probability  measure  it 
is  a  stationary  distribution  for  the  corresponding  diffusion  if  and  only  if  (2) 
holds  with  inequality  replaced  by  equality  and  for  test  functions  /  E  C^(E), 
the  space  of  twice  continuously  differentiable  functions  with  compact  sup¬ 
port  on  E.  Extensions  of  Echeverria’s  criterion  were  obtained  by  Bhatt  and 
Karandikar  [5],  who  relaxed  the  local  compactness  condition  on  E,  and  by 
Stockbridge  [41]  and  Bhatt  and  Borkar  [4],  who  extended  it  to  controlled 
processes.  An  extension  of  Echeverria’s  criterion  to  reflected  diffusions  in 
smooth  domains  defined  by  well-posed  submartingale  problems  was  first 
obtained  by  Weiss  in  his  PhD  thesis  [47].  However,  the  results  of  [47]  do 
not  apply  to  reflected  diffusions  in  non-smooth  domains  in  .  Kurtz  and 
Stockbridge  [29,  30]  further  extended  Weiss’  result  to  obtain  abstract  suffi¬ 
cient  conditions  for  existence  of  stationary  solutions  to  more  general  Markov 
processes  defined  in  terms  of  controlled  and  singular  martingale  problems. 
However,  the  framework  of  controlled  martingale  problems  in  [29,  30]  can¬ 
not  be  used  to  uniquely  characterize  non-semimartingale  reflected  diffusions, 
and  hence,  is  not  suitable  for  the  analysis  of  more  general  processes  of  in- 


9 


6  W.  N.  KANG  AND  K.  RAMANAN 

terest  under  study  here,  which  can  be  characterized  via  the  submartingale 
problem.  Nevertheless,  we  use  a  result  from  [30]  in  our  proof  of  Theorem 

1,  and  also  clarify  the  connection  between  the  stationary  solutions  in  [30] 
and  stationary  solutions  to  well-posed  submartingale  problems,  which  have 
been  used  more  widely  in  the  literature  to  characterize  reflected  diffusions 
in  curved  domains. 

For  a  class  of  semimartingale  RBMs  in  the  non-negative  orthant  associ¬ 
ated  with  so-called  Ai -reflection  matrices,  a  certain  basic  adjoint  relation 
(BAR),  which  is  related  to  the  adjoint  PDE  established  in  Theorem  3,  was 
established  in  the  seminal  work  of  Harrison  and  Williams  in  [24]  (see  also 
[10]  for  an  extension).  However,  there  are  many  RBMs  of  interest  that  fall 
outside  the  domain  of  the  results  of  [24,  10]  such  as,  for  example,  RBMs 
in  polygons  in  M2,  considered  in  the  work  of  Harrison,  Landau  and  Shepp 
[22],  which  could  fail  to  be  semimartingales  for  some  parameter  values.  In 
particular,  Theorem  3  of  the  present  paper  rigorously  establishes  that  the 
solution  to  the  PDE  in  two-dimensional  polygonal  domains  obtained  in  [22] 
is  indeed  the  stationary  density  of  the  associated  RBM  (see  Example  4.3). 
Indeed,  the  result  of  Weiss  [47],  which  was  cited  in  [22]  to  relate  their  ana¬ 
lytical  result  to  the  stationary  distribution  of  the  RBM,  does  not  cover  the 
case  of  non-smooth  polygonal  domains  studied  in  [22],  As  mentioned  above, 
the  identification  of  a  large  class  of  reflected  diffusions  with  stationary  den¬ 
sity  of  Gibbs  form  generalizes  some  of  the  results  obtained  for  RBMs  with 
constant  drift  by  Harrison  and  Williams  in  [23,  49]. 

Finally,  the  boundary  property  established  in  Proposition  6.1)  can  be 
viewed  as  a  generalization  of  results  in  [24,  11]  (see  also  [49])  for  semi¬ 
martingale  reflecting  Brownian  motions  in  the  orthant  or  in  more  general 
convex  polyhedral  domains,  to  more  general  reflected  diffusions  in  possibly 
curved  domains. 

1.3.  Outline  of  the  Paper.  Section  2  contains  a  precise  definition  of  the 
submartingale  problem  and  of  a  class  of  reflected  diffusions  in  piecewise 
domains.  In  Section  3.1  the  first  main  results  of  the  paper,  Theorems  1  and 

2,  are  stated.  The  proofs  of  Theorem  1  and  Theorem  2  are  given  in  Section 
5  and  Section  7,  respectively,  and  Section  4  contains  illustrative  examples  of 
reflected  diffusions  for  which  the  assumptions  of  the  two  theorems  are  valid. 
In  Section  3.2,  several  consequences  of  Theorems  1  and  2  are  established, 
including  the  adjoint  PDE  (Theorem  3),  identification  of  strictly  positive 
solutions  under  suitable  assumptions  (Corollaries  1  and  2)  and  illustrative 
examples.  Finally,  the  boundary  property  is  stated  and  proved  in  Section  6. 
The  proofs  of  some  technical  lemmas  are  relegated  to  the  Appendix.  In  the 
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next  section,  we  summarize  some  common  notation  used  in  the  paper. 

1.4.  Notation  and  Terminology.  The  following  notation  is  used  through¬ 
out  the  paper.  Z  is  the  set  of  integers,  N  is  the  set  of  positive  integers,  M  is 
the  set  of  real  numbers,  Z+  is  the  set  of  non-negative  integers  and  R+  the 
set  of  non-negative  real  numbers.  For  each  J  £  N,  RJ  is  the  J-dimensional 
Euclidean  space  and  |  •  |  and  (•,•},  respectively,  denote  the  Euclidean  norm 
and  the  inner  product  on  RJ .  Vectors  will  be  represented  as  column  vectors, 
and  for  each  vector  v  £  RJ  and  matrix  cr  £  RJ  x  RN ,  vT  and  aT  denote 
the  transpose  of  v  and  cr,  respectively.  Given  a  square  matrix  A  £  RJxJ, 
diag(A)  represents  the  column  vector  containing  the  diagonal  elements  of  A 
and  tr(A)  denotes  the  trace  of  A,  equal  to  J2i=  l  Ac  For  each  set  A  C  RJ, 
A°,  dA,  A  and  Ac  denote  the  interior,  boundary,  closure  and  complement 
of  A,  respectively.  For  each  x  £  RJ  and  A  C  RJ ,  dist(x,  A)  is  the  dis¬ 
tance  from  x  to  A  (that  is,  dist(x,  A)  =  inf{y  £  A  :  \y  —  x|}).  For  each 
AcRJ  and  r  >  0,  Br(A )  =  {y  £  MJ  :  dist(y,  A)  <  r},  and  given  e  >  0 
let  Ae  =  {y  £  :  dist(y,  A)  <  e}  denote  the  (open)  e-fattening  of  A.  If 

A  =  {x},  we  simply  denote  Br(A )  by  Br(x).  We  will  use  Si(0)  to  denote 
the  unit  sphere  in  RJ .  We  also  let  I  a  denote  the  indicator  function  of  the 
set  A  (that  is,  1 Ia{x)  =  1  if  x  £  A  and  Ia(t)  =  0  otherwise). 

Given  a  domain  E  in  Mn,  for  some  n  £  N,  let  C(E)  =  C°(E)  be  the 
space  of  continuous  real-valued  functions  on  E  and,  for  any  m  £  Z+  U 
{oo},  let  Cm(E)  be  the  subspace  of  functions  in  C(E)  that  are  m  times 
continuously  differentiable  on  E  with  continuous  partial  derivatives  of  order 
up  to  and  including  m.  When  E  is  the  closure  of  a  domain,  Cm(E)  is  to  be 
interpreted  as  the  collection  of  functions  in  n£>o Cm(E£),  where  E£  is  an  open 
e-neighborhood  of  E,  restricted  to  E.  Also,  let  C™(E)  be  the  subspace  of 
Cm(E )  consisting  of  bounded  functions  whose  partial  derivatives  of  order  up 
to  and  including  m  are  also  bounded,  let  C™{E)  be  the  subspace  of  Cm(E ) 
consisting  of  functions  that  vanish  outside  compact  sets.  In  addition,  let 
C™{E)  ©M  be  the  direct  sum  of  C™(E)  and  the  space  of  constant  functions, 
that  is,  the  space  of  functions  that  are  sums  of  functions  in  C™(E)  and 
constants  in  M.  For  definitions  of  the  space  of  functions  or  vector  fields  on 
E  that  are  of  class  Cm  for  some  non-integral  m,  we  refer  the  reader  to 
a  standard  book  on  partial  differential  equations  [21].  If  m  =  0,  we  denote 
Cm(E),  C™(E),  C™(E),  C“(F)®K  simply  by  C(E),  Cb(E),  Cc(E),  Cc(E)©M, 
respectively.  The  support  of  a  function  /  is  denoted  by  supp (/),  its  gradient 
of  /  is  denoted  by  V/  and  the  Laplacian  of  /  is  denoted  by  A/.  We  say  a 
set- valued  function  /(•)  defined  on  a  subset  E  of  is  continuous  at  x  £  E 
if  for  every  e  >  0,  there  exists  a  neighbourhood  Ox  C  E  of  x  such  that 
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f(y)  C  Be(f(x))  for  each  y  E  Ox  and  we  say  /(•)  is  continuous  on  E  if  it  is 
continuous  at  each  x  E  E. 

The  space  of  continuous  functions  on  [0,  oo)  that  take  values  in  RJ  is 
denoted  by  C  [0,  oo),  the  Borel  u-algebra  of  C  [0,  oo)  is  denoted  by  M,  and 
the  natural  filtration  on  C  [0,  oo)  is  denoted  by  {A it}.  The  Borel  u- algebra 
of  G  is  denoted  by  13(G). 

2.  A  Class  of  Reflected  Diffusions.  In  this  section  we  introduce  the 
class  of  reflected  diffusions  that  we  consider.  Let  G  be  a  nonempty  connected 
domain  in  RJ,  and  let  d(-)  be  a  set-valued  mapping  defined  on  G,  such  that 
each  d(x),  x  E  dG,  is  a  non-empty  closed  convex  cone  in  RJ  with  vertex  at 
the  origin  0,  d(x)  =  {0}  for  each  x  in  G°,  and  the  graph  of  d(-)  is  closed, 
that  is,  the  set  {(x,  v)  :  x  E  G,  v  E  d(x)}  is  a  closed  subset  of  R2J.  Let  V  be 
a  subset  of  dG.  As  shown  in  Section  4,  V  will  typically  be  a  (possibly  empty) 
subset  of  the  non-smooth  parts  of  the  boundary  of  the  domain  G  where  d(-) 
is  not  sufficiently  well  behaved.  For  each  function  /  defined  on  R^,  we  say  / 
is  constant  in  a  neighborhood  of  V  if  for  each  x  G  V,  /  is  constant  in  some 
open  neighborhood  of  x.  Given  measurable  drift  and  dispersion  coefficients 
b  :  RJ  i-a  RJ  and  a  :  RJ  i-a  RJ  x  R^,  and  a  =  acrT  :  RJ  i-a  RJ  x  RJ,  let  C  be 
the  associated  differential  operator  defined  in  (1).  One  way  of  characterizing 
a  reflected  diffusion  is  through  the  so-called  submartingale  problem.  The 
submartingale  problem  is  a  generalization  of  the  martingale  problem  that 
was  first  introduced  in  [44]  to  characterize  the  law  of  reflected  diffusions  in 
smooth  domains.  Extensions  of  the  submartingale  problem  to  characterize 
RBMs  in  two-dimensional  piecewise  smooth  domains  were  considered  in  var¬ 
ious  works  [12,  13,  46]  and  multi-dimensional  RBMs  that  satisfy  a  special 
skew-symmetry  condition  was  considered  in  [49].  Definition  2.1  generalizes 
these  formulations  further  to  accommodate  a  more  general  class  of  multi¬ 
dimensional  reflected  diffusions.  As  mentioned  earlier,  a  suitable  formulation 
of  the  submartingale  problem  for  multi-dimensional  reflected  diffusions  that 
need  not  be  semimartingales  has  long  been  a  challenging  problem  [50].  Re¬ 
mark  2.4  provides  further  discussion  of  this  formulation,  and  in  particular, 
of  the  role  of  the  set  V.  In  what  follows,  recall  that  C2(G)  ©R  is  the  space  of 
functions  that  are  sums  of  functions  in  C2((5)  and  constants  in  R,  and  that 
V/  denotes  the  gradient  of  a  function  /  on  a  domain  in  R*7.  Given  a  subset 
V  C  dG ,  let  %  =  74 y  be  the  set  of  functions 

xi  —  f  /  ^  ^2(G)  ©  R  :  /is  constant  in  a  neighborhood  of  V,  1 
\  (d,  V  f(y))  >  0  for  d  G  d(y )  and  y  G  dG  J  ' 

When  V  is  the  empty  set,  the  condition  that  /  be  constant  in  a  neighborhood 
of  V  is  understood  to  be  void.  When  V  is  a  disjoint  union  of  connected 
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subsets,  the  condition  that  /  be  constant  in  a  neighborhood  of  V  means 
that  /  is  constant  in  a  neighborhood  of  each  connected  subset. 


Definition  2.1.  (Submartingale  Problem)  A  family  {<Qh,z  G  G}  of 
probability  measures  on  (C  [0, oo),A4)  is  a  solution  to  the  submartingale 
problem  associated  with  (G,d(-)),  V,  drift  b(-)  and  dispersion  a(-)  if  for  each 
A  G  M,  the  mapping  z  i-A  Q2(A)  is  B(G) -measurable  and  for  each  z  G  G, 
Qz  satisfies  the  following  three  properties: 

1.  Qz(w(0)  =  z)  =  1; 

2.  For  every  t  G  [0,  oo)  and  f  G  FL\>  hi  C( (MJ),  the  process 

(4)  f(u(t))~  [  £f(u(u))du,  t>  0, 

Jo 

is  a  Qz-submartingale  on  (C  [0,  oo)  ,A4, 

3.  For  every  z  G  G, 


JgQz 


Iy(cj(s))  ds 


IJO 


=  0. 


In  this  case,  Qz  is  said  to  be  a  solution  to  the  submartingale  problem  starting 
from  z.  Moreover,  given  a  probability  distribution  ir  on  G,  the  probability 
measure  Q^,  defined  by 


(5)  Qn(A)  =  f  Qz(A)  n (dz),  for  every  A  G  M, 

Jg 

is  said  to  be  a  solution  to  the  submartingale  problem  with  initial  distribution 

7T. 


The  first  condition  in  Definition  2.1  simply  states  that  the  family  of  mea¬ 
sures  is  parameterized  by  the  initial  condition.  The  second  condition  in  Def¬ 
inition  2.1  captures  the  notion  of  diffusive  behavior  in  the  interior,  and 
reflection  along  the  appropriate  directions  on  the  boundary.  Since  the  “test 
functions”  in  property  2  are  constant  in  a  neighbourhood  of  V,  this  con¬ 
dition  does  not  provide  information  on  the  behavior  of  the  diffusion  in  a 
neighborhood  of  V.  The  third  condition  is  imposed  to  ensure  instantaneous 
reflection  (precluding  the  possibility  of  absorption  or  partial  reflection)  on 
the  boundary.  A  canonical  choice  for  the  set  V  is  given  below  in  (7). 

Definition  2.2.  The  submartingale  problem  associated  with  (G,d{-)), 
V ,  drift  b(-)  and  dispersion  a(-)  is  said  to  be  well  posed  if  there  exists  exactly 
one  solution  to  the  submartingale  problem. 
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We  will  only  consider  submartingale  problems  that  are  well  posed.  In 
addition,  we  will  also  assume  throughout,  without  explicit  mention,  that 
the  drift  and  diffusion  coefficients  are  continuous.  Under  this  assumption, 
for  every  /  E  the  mapping  x  i-A  Cf(x)  is  continuous,  and  so  the 

integral  in  (4)  is  clearly  well  defined. 

We  next  consider  reflected  diffusions  associated  to  the  submartingale 
problem. 

Definition  2.3.  A  stochastic  process  Z  defined  on  a  probability  space 
(DjJ7,  P)  is  said  to  be  a  reflected  diffusion  associated  with  (G,d(-)),  V,  drift 
b(-)  and  dispersion  cr(-)  if  its  family  of  distribution  laws  {Qz,  z  £  G}  is  the 
unique  solution  to  the  submartingale  problem,  where  for  z  £  G,  Qz  is  the 
conditional  distribution  of  Z  under  P,  conditioned  on  Z( 0)  =  z. 

Remark  2.4.  When  the  domain  G  is  smooth,  the  class  of  test  func¬ 
tions  used  in  the  definition  of  the  submartingale  problem  are  the  functions 
in  T-L  with  V  =  0,  so  that  property  3  of  Definition  2.1  is  essentially  absent 
[43] .  The  analysis  of  reflected  diffusions  in  non-smooth  domains  via  the  sub¬ 
martingale  problem  has  to  a  large  extent  concentrated  on  the  case  when 
the  set  of  non-smooth  points  is  a  singleton  or  a  collection  of  isolated  points 
[12,  13,  23,  31,  46]  (an  exception  is  [49],  where  the  RBM  can  be  shown  not 
to  hit  the  non-smooth  parts  of  the  domain).  In  each  of  these  cases,  the  sub¬ 
martingale  problem  has  been  defined  with  V  equal  to  the  non-smooth  part 
of  the  boundary  dG. 

One  natural  extension  of  the  submartingale  problem  to  higher  dimensions 
would  be  to  continue  to  set  V  in  Definition  2.1  to  be  the  subset  of  non-smooth 
points  of  the  boundary  dG.  However,  the  corresponding  set  of  test  functions 
%  =  Hv  would  then  fail  to  satisfy  separability  properties  (see  Assumption 
1)  that  are  typically  required  for  natural  approaches  to  the  characterization 
of  stationary  distributions  to  succeed. 

We  take  a  slightly  different  approach.  In  the  analysis  of  reflected  diffusions 
in  non-smooth  domains,  a  special  role  is  played  by  the  following  set  on  the 
boundary: 

(6)  U  =  {x  E  dG  :  3  n  E  n(x)  such  that  (n,  d)  >  0,  V  d  E  d(x)  \  {0}}. 

Here,  n{x)  is  the  set  of  interior  normal  vectors  to  the  domain  G  at  x  E 
dG.  Indeed,  the  condition  dG  =  U  can  be  viewed  as  a  generalization  of 
what  is  known  in  the  literature  as  the  completely-5  condition  [39,  45,  35]. 
The  boundary  property  in  Proposition  6.1  shows  that  (for  a  large  class  of 
domains),  any  solution  to  the  submartingale  problem  with  V  D  dG  \  U 
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spends  zero  Lebesgue  time  on  the  boundary  of  dG.  This  suggests  that  a 
canonical  choice  of  V  in  Definition  2.1  is  to  set 

(7)  V  =  dG  \  U. 

Further  justification  for  this  choice  arises  from  the  fact  that  then  the  re¬ 
sulting  submartingale  problem  is  well-posed  for  a  large  class  of  multidimen¬ 
sional  semimartingale  and  non-semimartingale  RBMs  in  both  polyhedral 
and  curved  domains  that  arise  in  a  variety  of  applications.  Indeed,  this  well- 
posedness  follows  from  a  general  result  proved  in  [28],  which  shows  that 
under  fairly  general  conditions,  the  submartingale  problem  with  V  =  dG\U 
is  well-posed  if  and  only  if  there  exists  a  weak  solution  to  the  corresponding 
SDER  that  is  unique  in  law,  together  with  results  that  establish  the  latter 
property  in  quite  some  generality  [45,  26,  36,  37,  25]  (also  see  Examples  4.4 
and  4.5). 

3.  Statement  of  Results.  The  primary  goal  of  this  work  is  to  provide 
a  useful  characterization  of  the  stationary  distributions  of  a  broad  class  of 
reflected  diffusions  that  includes  several  families  of  reflected  diffusions  that 
arise  in  applications.  In  Section  3.1  we  state  our  assumptions  and  the  main 
results,  and  in  Section  3.2  we  derive  some  important  consequence  of  the 
main  result. 


3.1.  Main  Results.  We  start  with  a  basic  definition. 


Definition  3.1.  A  probability  measure  n  on  G  is  a  stationary  distri¬ 
bution  for  the  unique  solution  {Q2,£  G  G}  to  a  well  posed  submartingale 
problem  if  it  satisfies  the  property  that  the  law  of  u(t)  under  Qn  is  7 r  for 
each  t  >  0.  In  this  case,  it  is  also  said  to  be  a  stationary  distribution  of  any 
reflected  diffusion  associated  with  the  well  posed  submartingale  problem. 


The  main  result  of  this  paper  is  a  necessary  and  sufficient  condition  for 
a  probability  measure  ir  to  be  a  stationary  distribution  for  the  well  posed 
submartingale  problem.  Recall  the  definition  of  R  in  (3).  It  is  easy  to  see  that 
if  the  unique  solution  {Qz,2:  6  G]  to  a  well  posed  submartingale  problem 
associated  with  ( G,d( •))  and  V  admits  a  stationary  distribution  7 r,  then  7r 
must  satisfy  the  inequality  (2)  for  all  f  £71,  where  £  is  the  operator  defined 
in  (1).  Indeed,  it  follows  from  the  second  property  in  Definition  2.1  that  for 
each  f  €.71, 


/  £f(u(u))du 


>  [/MO))] 
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Since  E'®’1'  [/(w(t))]  =  E1®77  [/(cu(0))]  due  to  the  stationarity  of  vr,  this  estab¬ 
lishes  the  inequality  in  (2)  for  all  functions  /  G  TL.  We  will  show  that,  under 
the  assumption  stated  below,  the  later  condition  is  also  sufficient  for  any 
probability  measure  ir  with  ir(dG)  =  0  to  be  a  stationary  distribution  of 
{Q2,  z  G  G}. 

Assumption  1.  The  setTL  has  the  following  two  properties: 

1.  TL  separates  points  in  the  sense  that  for  any  two  different  points  x,  y  G 
G,  there  exists  a  function  f  G  TL  such  that  f(x)  fi  f(y); 

2.  For  every  r,s  >  0,  there  exists  a  function  fr_s  G  TL  nC)?(G)  such  that 
for  every  x  G  d G  with  \x\  <  r  and  dist(x,  V)  >  s  and  d  G  d(x)  n  S'i(O), 
<d,V/r,a(x))>l. 

Remark  3.2.  If  d()  n  S'i(O)  is  continuous  as  a  set-valued  function  on 
dG\V  (see  Section  1.4  for  the  definition),  then  property  2  of  Assumption  1  is 
equivalent  to  the  seemingly  weaker  condition  that  for  each  x  G  dG\ V,  there 
exists  a  function  /  G  TL  such  that  (d,  V/(x))  >  0  for  each  d  G  d(x)  n  S’i(O). 
By  replacing  /  by  /  —  lim|xi_>.00  f(x),  we  can  assume  that  for  any  x  G  dG 
the  function  /  lies  in  TL  n  Cf,(G).  Moreover,  by  the  continuity  of  V/  and 
the  continuity  of  d(-)  n  5i(0),  for  any  x  G  dG  \  V,  there  exists  an  open 
neighbourhood  Ox  of  x  such  that  (ci,  V/(y))  >  0  for  d  G  d(y)  n  <Si(0)  and 
y  G  Ox  n  dG.  Then,  since  TL  n  C'f.(G)  is  closed  under  addition,  given  any 
compact  set  K  C  dG  \  V,  a  standard  finite  subcovering  argument  can  be 
used  to  construct  /  G  TLnCf(G)  such  that  in£ded(y)nSi(o),yeK(d,V f(y)}  >  0. 
Since  /  G  TL  implies  af  G  TL  for  any  a  >  0,  one  can  ensure  that  the  last 
infimum  is  greater  than  1  (or  any  given  specified  value  C  <  oo).  In  particular, 
the  above  argument  can  be  applied  to  the  compact  set  K  =  {iG  dG  :  \x\  < 
r,  dist(x,  V)  >  s}  for  any  r,s>  0. 

We  now  state  the  first  main  result  of  this  paper.  Its  proof  is  given  in 
Section  5.  Recall  that  we  assume  throughout  that  the  drift  and  diffusion 
coefficients  are  continuous. 

Theorem  1.  Suppose  we  are  given  (G,d(-)),  b(-),  a(-)  and  a  finite  set  V 
such  that  the  associated  submartingale  problem  is  well  posed  and  Assumption 
1  holds.  Let  ir  be  a  probability  measure  on  (G,  13(G))  with  ir(dG)  =  0.  Then 
it  satisfies  the  inequality  (2)  for  all  f  G  TL  if  and  only  if  ir  is  a  stationary 
distribution  for  the  unique  solution  to  the  associated  submartingale  problem. 

We  now  introduce  a  broad  class  of  data  ( G,d( •))  and  V  for  which  the 
stationary  distribution  characterization  obtained  in  Theorem  1  applies. 
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Definition  3.3.  For  0  <  k  and  i  <  k,  the  pair  ( G,d( •))  is  said  to  be 
piecewise  Ck  with  Ce  reflection  if  G  and  d(-)  satisfy  the  following  properties: 

1.  The  domain  G  is  a  nonempty  domain  with  representation  G  =  D  iexGi, 
where  Z  is  a  finite  index  set  and  for  each  i  €  Z,  Gi  is  a  nonempty  do¬ 
main  with  Ck  boundary,  that  is,  there  exists  a  Ck  function  on 
such  that  V0*(x)  0  for  all  x  £  d G, 

Gi  =  {x  :  (fl{x)  >  0}  and  dGi  =  {x  :  4>z(x)  =  0}. 

Let  nl{x)  =  \7c/)l(x)/\\(j)z(x)\\  denote  the  unit  inward  normal  vector  to 
dGi  at  x  £  dGi  and  define 

(8)  Z{x)  =  {iel:  a;  £  dGi}, 

and  note  that  for  each  x  £  dG,  the  set  of  inward  normals  to  G  at  the 
point  x  is  given  by 


(9) 


n(x)  =  ^  Sinl{x),  Si  >  0,  i  G  X{pc) 

i€.T(  x) 


2.  The  direction  vector  field  d(-)  is  given  by 


(10)  d(x)  =  <  ^2  Sirf(x),  Si  >  0,  i  £  Z(x)  }  ,  x  £  dG, 

^  iei(x) 

where  for  each  i  £  X,  fl{-)  is  a  vector  field  defined  on  dGi  such  that 

(11)  (nz (x) ,  (x))  =  1,  for  each  x  £  dGi, 

and  Y*(')/IIy*(')II  °f  class  Ce . 


Note  that  in  property  2  above,  the  condition  [nl(x),  ryl{x))  =  1  f°r  each 
x  £  dGi  is  equivalent  to  the  seemingly  weaker  condition  that  (nz  (x) ,  (x))  > 

0,  because  the  vector  field  jl(x)  can  always  be  renormalized  without  chang¬ 
ing  the  definition  of  d(-). 


Assumption  2.  V  is  a  finite  set  such  that  V  D  dG\U,  and  ifV  contains 
at  least  two  elements,  then  for  each  x  £  V,  there  exist  a  unit  vector  vx  and  a 
constant  px  >  0  such  that  (vx,'y l(y))  >  0  for  each  i  £  Z(y)  and  y  £  BPx(x). 
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Remark  3.4.  Note  that  the  finiteness  assumption  is  reasonable  given 
the  canonical  choice  of  V  in  (7).  Also,  note  that  Assumption  2  is  trivially 
satisfied  when  dG  =  U,  and  V  =  0.  In  the  context  of  certain  polyhedral 
domains  with  piecewise  constant  reflection  fields,  the  condition  V  =  0  has 
been  shown  to  be  necessary  and  sufficient  for  the  associated  reflected  diffu¬ 
sion  to  be  a  semimartingale  [35,  39,  45].  However,  in  this  work  we  also  allow 
for  cases  when  dG  U ,  thus  providing  a  characterization  of  the  stationary 
distribution  for  reflected  diffusions  that  are  not  necessarily  semimartingales 
[13,  6,  26,  35], 

We  now  state  the  second  main  result  of  this  paper,  whose  proof  is  given 
in  Section  7.  Recall  that  the  diffusion  coefficient  a(-)  is  said  to  be  uniformly 
elliptic  if  there  exists  a  >  0  such  that 

(12)  uT a(x)u  >  a\u\2  for  all  u  G  Mj,.t  G  G. 

We  will  assume  this  condition  for  simplicity  when  stating  the  second  part 
of  the  result,  although  only  partial  uniform  ellipticity  in  a  certain  direction 
at  each  x  G  dG  \  V  is  actually  required,  as  shown  in  (66). 

Theorem  2.  Suppose  that  ( G,d( •))  is  piecewise  C1  with  continuous  re¬ 
flection.  If  V  satisfies  Assumption  2,  then  Assumption  1  holds.  Moreover, 
if  ( G,d( •))  is  piecewise  C2  with  continuous  reflection,  the  diffusion  coeffi¬ 
cient  a(-)  is  uniformly  elliptic,  and  the  submartingale  problem  associated 
with  (G,d(-)),  b(-),  cr(-)  and  V  is  well  posed,  then  a  probability  measure  it 
on  G  is  a  stationary  distribution  for  the  associated  reflected  diffusion  if  and 
only  if  ir(dG)  =  0  and  the  inequality  condition  (2)  is  satisfied. 

As  an  immediate  consequence  we  see  that  Theorem  1  can  be  used  to  char¬ 
acterize  the  stationary  distributions  of  reflected  diffusions  that  satisfy  the 
conditions  of  Theorem  2  and  are  associated  with  well-posed  submartingale 
problems.  As  shown  in  Section  4,  this  includes  many  classes  of  reflected 
diffusions  that  arise  in  applications. 

3.2.  Some  Consequences  of  the  Main  Results.  We  now  describe  some 
ramifications  of  the  main  results.  First,  let  C*  be  the  adjoint  operator  to  C: 
for  p  G  C2(G), 


C*p(x) 


1  J  d2  J  d 
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We  start  by  showing  that  nonnegative  and  integrable  solutions  of  a  certain 
adjoint  partial  differential  equation  (with  boundary  conditions),  are  indeed 
stationary  distributions  for  the  submartingale  problem.  In  what  follows,  let 
S  denote  the  smooth  parts  of  the  boundary  dG. 

Theorem  3.  Suppose  that  the  pair  ( G,d( •))  is  piecewise  C 1  with  C1  re¬ 
flection,  (11)  is  satisfied,  V  C  dG  satisfies  Assumption  2  &*(• )  G  Cl(G), 
Oy(- )  €  C2(G)  for  i,j  =  1, . . . ,  J ,  and  the  submartingale  problem  associated 
with  ( G,d( •))  and  V  is  well  posed.  Furthermore,  suppose  there  exists  a  non¬ 
negative  function  p  G  C2(G  \  V)  with  jc-,p{x)dx  <  oo  that  solves  the  adjoint 
PDE  defined  by  the  following  three  relations: 

1.  C*p(x)  =  0  for  x  G  G; 

2.  for  each  i  G  I  and  x  G  dGi  Cl  S , 

(13)  —2 p(x)  (nl(x),  b(x ))  +  (n* (x))T a(x)V p(x) 

-V  •  (p(x)ql(x))  +p(x)Ki(x)  =  0, 

where  for  i  G  Z, 

(14)  q\x)  =  (ni(x))Ta(x)n*(T)  jl(x)  —  a(x)nfix), 
and 

J  J  a 

Kfix)  =  (nfix),  V  •  a(s)>  =  ^n\(x)  -^-(x); 

fc=i  j=i  3 

3.  for  each  i,  j  G  Z,  i  j ,  and  x  G  dGi  H  dGj  Cl  dG  \  V, 

(15)  p(x)  [(ql(x),nj(x))  +  (qj (x) ,  nl (x)))  =  0. 

Then  the  probability  measure  on  G  defined  by 

<“>  ■4£S(e)' 

is  a  stationary  distribution  for  the  well-posed  submartingale  problem. 

Note  that  when  a(-)  is  constant  and  equal  to  I ,  the  J  x  J  identity  matrix, 
qf  in  (14)  represents  the  component  of  the  reflection  vector  field  7*  that  is 
tangential  to  dG. 

Proof  of  Theorem  3.  By  Theorems  1  and  2,  it  suffices  to  show  that 
the  probability  measure  ir  defined  in  terms  of  p  via  (16)  satisfies  the  inequal¬ 
ity  (2)  for  all  functions  /  G  TL  Cl  C2(G).  For  any  such  function  /,  straightfor¬ 
ward  calculations  show  that  for  each  xgG, 

p{x)Cf{x)  -  f(x)C*p(x)  =  •  r(x), 


(17) 
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where  r(-)  =  r^(-)  is  the  vector  held  whose  zth  component  is  given  by 
J 

n(x)  = 

3= 1 

+2  bi(x)f(x)p(x). 


p(x)a,ij(x ) 


df{x) 

dXn 


-  f(x)dij(x) 


dp(x) 

dxj 


~  f(x)p(x 


dajjjx] 

dxj 


Since,  by  assumption,  C*p(x)  =  0  for  x  £  G,  and  /  has  compact  support 
and  vanishes  in  a  neighborhood  of  V,  the  Divergence  Theorem  implies  that 

(18)  p(x)Cf(x)dx  = 

Jg 


where  n(-)  is  the  outward  pointing  unit  normal  held  on  dG,  p(dx)  is  the 
surface  measure  on  dG ,  and  pi(dx)  is  the  surface  measure  on  dG  n  dGi  for 
each  i  £  1.  Now,  for  each  i  £  X  and  x  £  dG  n  dGi,  we  have 

( nz(x),r(x ))  =  p(x)(n*(x))Ta(x)V/(x)  —  /(x)(n*(x))Ta(x)Vp(x) 

-f(x)p(x)Ki(x)  +  2  f(x)p(x)  (: n\x ),  6(x))  . 

Since  /  £  'H,  gS7 f ,  /Vg  and  fg  vanish  in  a  neighborhood  of  V.  Thus, 
combining  the  above  display,  (18)  and  relation  (13)  of  the  adjoint  PDE,  we 
obtain 

f  Cf(x)p(x)dx  =  [  p(x)(nl(x))Ta(x)Vf(x)dpi(x) 

Jg  Z  JdGiCdG 

I  /(-T)V  '  (p(x)Qz(x))dpi{x). 
z  JaG^dG 


IG 


V • r(x)p(dx) 


1 


2  79G 

--E 
2  ^ 

iei 


(n(x),r(x))fi(dx) 

(n*(x),r(x))  dpi(x), 


IdGiCdG 


For  each  i  £  X  and  x  £  <9(7*  n  9G,  substituting  for  ql  from  (14),  we  have 

V  •  (f(x)p(x)ql(x))  =  /(x)V  •  (p(x)g*(x))  +  (y*(x),  V/(x))p(x)(n*(x))Ta(x)n*(x) 

— p(x)(V/(x))Ta(x)n*(x). 

In  turn,  the  last  two  equalities  imply  that  Jg  Cf(x)p(x)dx  is  equal  to 
(  V  •  if(x)p{x)ql(x))dpi(x) 

i(z%  ^ OGiHdG 

~ly]  [  (7*  (x) ,  V/  (x))p(x)  (nl  (x)  )Ta(x)n*  (x)dpi  (x) . 

Z  iix  •'<9Gin9G 
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The  second  term  above  is  non-positive  since  f  €  Ji,  p  >  0  and  a  is  positive 
semidefinite.  So,  we  shall  focus  on  the  first  term.  For  each  x  G  dGi  Cl  dG, 
(ri1  (x) ,  q1  (x))  =  0  because  of  the  assumed  normalization  (nl(x),  Y*(x)}  =  1. 
Therefore,  the  vector  ql(x)  is  parallel  to  dGi  at  x,  and  the  divergence  in  the 
first  term  of  the  last  display  is  equal  to  the  divergence  taken  in  the  ( J  — 
l)-dimensional  manifold  dGi  H  dG.  Another  application  of  the  Divergence 
Theorem  then  yields 

£/  V  •  (f(x)p(x)ql(x))dm{x) 
i(z/£  ^ dGiC\dG 

=  -  [  f{x)p(x)ql{x){nlJ(x),q\x))dnij(x), 

where  Fij  =  dGi  FI  dGj  Cl  dG,  ntJ(x)  denotes  the  unit  vector  that  is  normal 
to  both  and  nl{x)  at  x  and  points  into  dGi  H  S  from  F, \j,  and  /Jnj  (dx) 
is  the  surface  measure  on  the  (J  —  2)-dimensional  manifold  FtJ .  To  prove 
the  theorem,  it  suffices  to  show  that  the  last  equality  in  the  above  display 
is  zero.  To  do  this,  it  suffices  to  show  that  for  each  i,  j  G  I  with  i  ^  j  and 
x  G  F^  \  V , 

(19)  p(x)  ql(x))  +  (vPl(x),  ^(x)))  =  0. 

Since  nF (x)  is  normal  to  dGi  H  dGj  at  x  G  dGi  H  dGj,  it  must  lie  in  the 
two-dimensional  space  spanned  by  nl{x)  and  nJ  (x).  In  addition,  nl;>(x)  is  a 
unit  vector  normal  to  nl{x)  and  points  into  dGi  from  dGi  C\dGj.  Therefore, 
we  have 

nl\x )  =  ( n\x )  —  ( nl(x),n\x))nl(x))/(l  —  (nl{x),  •nP {x))2)1^2 , 

with  the  analogous  expression  for  rdt(x).  Since  (nk(x),  qk(x))  =  0  for  all 
k  G  X,  this  shows  that  (19)  is  equivalent  to  the  third  relation  (15)  of  the 
adjoint  PDE.  This  yields  the  desired  result.  □ 

Solutions  to  the  adjoint  PDE  have  been  identified  for  several  classes  of 
two-dimensional  RBMs  with  constant  drift  (see  [34],  [22],  [48],  [40],  [14] 
and  also  Examples  4.2  and  4.3),  and  for  a  class  of  multi-dimensional  RBMs 
with  constant  drift  satisfying  a  so-called  skew-symmetry  condition  on  the 
domain  and  covariance  in  [23].  Here,  we  consider  the  case  of  RBMs  with 
state-dependent  drifts,  and  investigate  the  analytical  question  of  when  the 
corresponding  adjoint  PDE  has  a  strictly  positive  solution  p,  thus  providing 
a  generalization  of  some  of  the  results  in  [23]. 
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Corollary  1.  Given  a  pair  ( G,d( •))  that  is  piecewise  C1 
flection,  a  constant  covariance  matrix  a(-)  =  A  G  MJxJ  and  a 
field  &(•)  :  G  H )•  MJ,  f/iere  exists  a  strictly  positive  solution  p(-) 
the  corresponding  adjoint  PDE  if  and  only  if  both  the  relation 


with  C1  re¬ 
drift  vector 
G  C2(G)  to 


(20)  (n*(x),  qi(x))  +  (nP(x),  ql(x))  =  0,  x  £  dGiH  dGj  (1  dG\V, 

holds  for  every  i,j  6  I,i  /  j,  and  there  exists  a  C2  function  H  :  G  H >  M 
that  satisfies  the  following  two  properties: 

1.  for  each  x  G  G, 

(21)  •  (AVff(i))  +  ^  (VH(x),AVH{x)}  -  V  •  6(x) 

-<Vtf(x),&(x)>=0; 


2.  for  each  i  G  X  and  x  G  <9Gi  n  5, 

(22)  —2 (nl(x),  b(x))  +  {Anl(x)  —  ql(x),  VH(x))  —  V  •  (<f  (x))  =  0. 

In  this  case,  p(x)  =  eH^x\  x  &  G,  is  a  positive  solution  of  the  adjoint  PDE. 

Proof.  First,  note  that  for  smooth  domains,  \X\  =  1  and  so  (20)  is  triv¬ 
ially  satisfied  whereas  for  non-smooth  domains,  relation  (15)  shows  that  (20) 
is  necessary  for  the  existence  of  a  strictly  positive  solution  p  of  the  adjoint 
PDE.  Elementary  calculations  show  that  a  strictly  positive  C 2  function  p 
satisfies  C*p{x)  =  0  for  x  G  G  if  and  only  if  the  C 2  function  H  =  hip  sat¬ 
isfies  equation  (21).  Next,  since  A  is  constant  implies  Kfl-)  =  0,  i  G  X,  p 
satisfies  relation  (13)  of  the  adjoint  PDE  if  and  only  if  H  =  In p  satisfies 

(23)  — 2(n*(x),  b(x))  +  (nflx),  AVH{x))  -  (qflx),  Vif(x))  -  V  •  {qflx))  =  0. 

But,  since  A  is  symmetric,  this  is  equivalent  to  equation  (22).  □ 

We  now  specialize  to  two  classes  of  domains  that  were  considered  in 
[23].  For  simplicity,  throughout,  we  assume  that  we  are  given  a  constant 
non-degenerate  covariance  matrix  (i.e.,  positive  definite,  symmetric  matrix) 
a(-)  =  tr(-)crT(-),  which  we  denote  by  A.  The  first  class  consists  of  (possi¬ 
bly  unbounded)  polyhedral  domains  (G,d(-)),  where,  for  i  G  1,  n*(-)  and 
7*(-),  are  both  constant  vector  fields,  which  we  denote  simply  by  nl  and 
7*,  respectively.  Let  qf  be  defined  as  in  (14),  and  let  N  and  Q  denote  the 
|Z|  x  J  matrices  whose  zth  rows  are  ( nl)T  and  (ql)T ,  respectively.  We  assume 
that,  for  some  c  G  MJ,  G  =  {x  G  :  Nx  >  c}  is  the  minimal  half-space 
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representation  of  the  (closure  of  the)  polyhedral  domain,  and  that  G  has 
non-empty  interior.  Finally,  we  also  assume  \T\  >  J  and  that  N  contains 
an  invertible  submatrix  N,  and  let  Q  denote  the  corresponding  submatrix 
obtained  of  Q.  We  further  assume  that  the  following  global  skew-symmetry 
condition  holds: 

(24)  Qt  =  -N~1QNt. 

Since  N  and  Q  are  corresponding  submatrices  of  N  and  Q,  (24)  immediately 
implies  that  N~1QI  is  skew-symmetric  and  then  by  (4.7)  of  [23],  NQT  is  also 
skew-symmetric.  Furthermore,  (24)  also  shows  that  N~1QT  is  independent 
of  the  choice  of  the  invertible  submatrix  N. 

The  second  class  we  will  consider  consists  of  smooth,  bounded  domains 
(G,  d(-))  that  are  C2+e  with  C1+£  reflection.  In  this  case,  \Z\  =  1  in  Definition 
3.3,  we  let  q(x)  =  qx(x)  be  defined  as  in  (14),  and  we  omit  the  superscript  1 
from  the  vector  Helds  n(-),  y(-)  and  q(-).  Choose  a  set  of  J  points  x\, . . .  ,xj, 
on  dG  such  that  the  normal  vectors  n(x i), . . .  ,n(xj),  are  linearly  indepen¬ 
dent  (such  a  set  exists  because  G  is  bounded),  and  let  N  (respectively  Q) 
denote  the  J  x  J  matrix  whose  ith  row  is  the  vector  ( n(xi))T  [respectively 
(q(xi))T].  We  now  consider  the  sub-class  of  domains  for  which  N~1QT  is 
skew-symmetric.  Since  q  is  C1+£,  it  follows  from  Lemma  3.2  of  [23]  that  this 
is  equivalent  to  the  condition  that  (24)  is  satisfied  for  any  pair  of  correspond¬ 
ing  L  X  J  matrices  N  and  Q  formed  in  an  analogous  fashion  from  any  set  of 
L  other  points  x\ , ,xl  £  9G,  which  in  turn  is  equivalent  to  the  condition 
that  (n(x),q(x))  +  (n(x),q(x)}  =  0  for  any  x,  x  G  G.  In  order  to  present 
both  classes  of  domains  in  a  common  framework,  we  phrase  the  global  skew- 
symmetry  condition  as  in  (24)  in  terms  of  the  pair  (N,  Q ),  noting  that  once 
again  N~lQT  does  not  depend  on  the  particular  choice  of  points  x\ ,xj 
(as  long  as  the  normals  are  linearly  independent).  We  refer  the  reader  to 
[23]  for  further  discussion  of  these  classes  of  domains.  We  will  use  b(  )  and 
the  data  ( N,Q ),  ( N,Q ),  A.  instead  of  (G,d(-)),  A  to  represent  members  of 
either  of  the  two  classes  above,  and  always  assume  that  the  data  satisfy  all 
the  stated  conditions.  We  introduce  the  notion  of  a  skew-transform,  which 
plays  an  important  role  in  the  analysis. 

Definition  3.5  (Skew-transform).  Given  data  ( N,Q ),  ( N,Q ),  A,  the 
skew-transform  (with  respect  to  (N,  Q),  A)  of  a  vector  field  v(-)  on  G,  is  the 
vector  field  u(-)  defined  by 


(25) 


u(x)  =  [A  —  N  lQ\  1n(.x),  x<eG. 
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Note  that  the  matrix  A  —  N~1Q  is  invertible  and  positive  definite  be¬ 
cause  A  is  positive  definite  and  N~lQ  is  skew-symmetric.  Hence,  the  skew- 
transform  of  the  vector  field  u(- )  is  well  defined.  Let  D  be  the  “reflection” 
matrix  whose  zth  row  is  given  by  7*,  and  let  D  be  the  corresponding  sub¬ 
matrix  of  D  corresponding  to  N  (and  Q ).  From  (14)  it  follows  that 

(26)  QT  =  diag (NANT)DT  -  ANT . 

Remark  3.6.  We  claim  that  the  matrix  NDT  is  positive  definite;  then 
D  is  invertible  since  N  is  invertible.  Observe  that  (26)  implies  that 

NDt  =  diag(N  ANt)~1[NQt  +  NANT ]. 

Since  A  is  positive  definite  and  NQT  is  skew-symmetric,  the  claim  follows. 

If  u(-)  is  the  skew-transform  of  u(-),  using  the  skew-symmetry  of  N~lQ 
and  invertibility  of  D,  we  have 

(27)  «(■)  =  [A  +  QT(NTr1}~1v(-)  =  NT  (DT)~1diag(N  ANt)~1v(-). 
When  A  =  I,  this  reduces  to  the  simple  form 

(28)  <)  =  iVT(JDT)-1u(-). 

Thus,  in  this  case,  the  skew-transform  maps  directions  of  reflection  into 
normal  directions. 

In  what  follows,  recall  that  a  vector  held  u(-)  on  G  is  said  to  be  conserva¬ 
tive  if  there  exists  a  C1  function  H  on  G  such  that  u(-)  =  VH.  In  this  case, 
H  is  said  to  be  the  potential  of  «(•). 

Corollary  2.  Given  data  (N,  Q),  ( N ,  Q)  and  A,  the  following  proper¬ 
ties  hold: 

1.  If  b(-)  is  a  C1(G)  vector  field  whose  skew-transform  is  conservative 
with  potential  H/ 2,  the  function  p  =  eH  £  C2(G)  is  a  strictly  positive 
solution  to  the  corresponding  adjoint  PDE; 

2.  Given  b(-),  H  andp  as  in  1.  above,  define  the  following  dual  quantities: 

(29)  6*(x)  =  —b(x)  +  AVH(x),  x  €  G, 

Q *  =  —Q,  and  Q*  =  —  N~lQ*NT , 

and  define  7*  in  terms  of  q\  =  Qjei  and  nl  via  (14)-  Then  p  is  also 
a  solution  to  the  adjoint  PDE  associated  with  (N,  Qf),  ( N ,  Q *),  A  and 
&*(■)■ 
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Proof.  Given  the  data,  the  global  skew-symmetric  condition  (24)  implies 
that  (i)  the  pointwise  skew  symmetric  condition  (20)  holds,  (ii)  V  •  ql  =  0 
(this  is  trivially  true  for  the  polyhedral  case  and  follows  from  Lemma  3.1 
of  [23]  in  the  smooth  case),  and  (iii)  H  and  b(-)  satisfy  equation  (22)  if 
—2 Nb(x)  +  [NA  —  Q]VH(x)  =  0  for  x  G  dG.  (Note  that,  while  this  last 
matrix  equation  implies  that  the  equation  (23)  is  satisfied,  it  is  not  equivalent 
to  that  equation  because  b  and  VH  are  not  constant).  When  H/ 2  is  the 
potential  of  the  skew-transform  of  &(•),  using  the  identities  V  •  ( CVF )  =  0 
and  (VF,GVF)  =  0  for  any  C2  function  F  and  skew-symmetric  matrix  C . 
it  is  easily  verified  that  (22)  and  (21)  are  satisfied. 

On  the  other  hand,  note  that  for  x  €  G, 

6*(®)  =  -hiA-  N~1Q]XH(x)  +  AVH{x)  =  \[A~  JV_1Q*]VfT(x). 

Since  Q *  =  —Q,  it  follows  that  N~1Qit:  is  also  skew-symmetric.  Thus,  H/2 
is  also  the  potential  of  the  skew-transform  of  6*  [with  respect  to  (JV,  Q*), 
A],  and  the  argument  used  in  1)  shows  that  6*  and  H  also  satisfy  the  cor¬ 
responding  equations  (22)  and  (21).  The  result  then  follows  from  Corollary 
1.  □ 

Remark  3.7.  We  now  discuss  well-posedness  of  the  submartingale  prob¬ 
lem  (equivalently,  existence  of  a  well  defined  RBM)  associated  with  the 
specified  data.  In  smooth  bounded  domains,  the  normalization  (11)  implies 
infxeQQ(n(x),  7(2;))  >  0,  and  thus  well-posedness  follows  from  the  discussion 
in  Example  4.1.  For  polyhedral  domains  we  claim  that  the  submartingale 
problem  is  well  posed  under  the  skew-symmetry  condition  (24),  Indeed,  by 
Lemma  3.1.3  of  [9],  the  positive  definiteness  of  NDT  established  in  Remark 
3.6  implies  that  there  exists  v  >  0  such  that  NDTv  >  0.  This  shows  that 
the  so-called  completely-5  condition  is  satisfied,  and  it  follows  from  [45]  and 
[11]  that  there  exists  a  weak  solution  that  is  unique  in  law  for  a  large  class  of 
polyhedral  domains  including,  in  particular,  simple  polyhedra.  When  com¬ 
bined  with  the  results  of  [28],  it  follows  that  the  submartingale  problem 
is  well  posed.  For  a  domain  in  this  class,  by  Theorem  3  the  solution  p  to 
the  adjoint  PDE  identified  in  Corollary  2  is  in  fact  an  invariant  density  for 
the  associated  reflected  diffusion  and,  when  C  =  J^p{x)dx  is  finite  (which 
is  always  true  when  G  is  smooth  and  bounded),  C~1p(x)dx  is  in  fact  the 
stationary  distribution.  Given  data  associated  with  smooth  and  bounded 
domains  that  satisfy  the  conditions  of  Corollary  2,  let  X  be  the  associated 
reflected  diffusion,  and  let  X *  be  the  reflected  diffusion  associated  with  the 
dual  data.  Since  Corollary  2  shows  that  the  (common)  stationary  distribu¬ 
tion  C~1p(x)dx ,  is  strictly  positive,  it  follows  from  [32,  33]  that  X  and  X * 
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are  dual  to  each  other  with  respect  to  the  stationary  distribution.  When 
the  data  is  associated  with  a  simple  polyhedron  and  C  <  oo,  the  duality 
property  in  the  case  of  constant  drifts  was  established  in  Corollary  1.1  of 
[49] .  Similar  arguments  can  be  used  to  extend  to  the  case  of  state-dependent 
drift,  but  we  do  not  provide  the  details  here. 

We  conclude  this  section  with  illustrative  examples  of  domains  and  drifts 
when  H  (and  therefore  p)  takes  an  explicitly  computable  form.  Here,  we  will 
repeatedly  use  the  well  known  property  that  (since  G  is  a  simply  connected 
domain)  a  necessary  and  sufficient  condition  for  a  C1  vector  field  to  be  con¬ 
servative  is  that  its  Jacobian  is  symmetric.  We  will  assume  throughout  that 
the  data  satisfies  the  global  skew-symmetry  condition  (24),  unless  explicitly 
stated  otherwise. 

Example  3.8.  When  Q  =  0  (i.e.,  normal  reflection  when  A  =  I),  it 
follows  from  Corollary  2  that  if  the  vector  field  A~lb{-)  is  conservative  with 
potential  H  £  C2(G),  then  p  =  eH  satisfies  the  adjoint  PDE. 

Example  3.9.  The  simplest  generalization  of  the  constant  drift  vector 
fields  considered  in  [23]  is  the  case  when  the  drift  points  along  a  constant 
direction,  but  has  varying  magnitude.  In  other  words,  b(x)  =  F(x)v  for 
some  v  £  RJx  J  and  C1  function  F  :  G  K >  M.  Let  u  be  the  skew-transform  of 
v.  By  Corollary  2,  for  the  adjoint  PDE  to  have  a  strictly  positive  solution 
p,  it  suffices  for  F(-)u  to  be  conservative,  which  holds  if  and  only  if  the 
Jacobian  of  F(-)u  is  symmetric.  The  latter  implies  that  VE  is  parallel  to 
u,  and  so  there  exists  a  C 1  function  r:M  aM  such  that  F(x)  =  r({x,u))', 
for  example,  one  can  fix  xo  €  G  and  use  a  path  integration  argument  to 
define  r(t)  =  F(xq)  +  \\u\\(t  -  (x0 ,u))  f ^  ||VE(x0  +  A (t  -  (x0,u))u)\\  dX.  If 
we  define  R(t)  =  f^r(s)ds,  then  clearly  H(x)  =  R((x,u ))  is  a  potential  for 
F{x)u.  Note  that  the  case  R,(x)  =  x  corresponds  to  the  case  of  constant 
drift.  When  combined  with  Corollary  2,  this  recovers  the  statements  “(ii) 
implies  (i)”  in  Theorems  2.1  and  6.1  of  [23]. 

Example  3.10.  We  now  study  the  case  of  a  linear  drift  vector  field, 
which  includes  reflected  Ornstein-Uhlenbeck.  We  establish  two  claims. 
Claim  1:  If  b(x)  =  Cx  for  some  C  £  RJxJ  such  that  C*  =  [A  —  N~1Q]~1C 
is  symmetric,  then  p  =  ex  c*x  solves  the  corresponding  adjoint  PDE. 

Proof  of  Claim  1:  Suppose  b(x)  =  Cx ,  for  C  £  MJx  J  as  in  the  claim.  Then 
the  skew-transform  of  b(-)  is  the  vector  field  u(x)  =  C*x,  whose  Jacobian 
is  C*,  and  hence  symmetric.  Thus,  u(-)  is  conservative  with  potential  H/ 2, 
where  H(x)  =  x^C^x.  The  claim  follows  from  Corollary  2.  In  particular, 
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when  A  =  N  =  I,  it  follows  from  (28)  that  any  drift  of  the  form  b(x)  = 
Dt Bx  for  some  symmetric  matrix  B  £  WJxJ  has  an  invariant  density  of 
Gibbs  form. 

We  now  prove  a  converse  to  claim  1.  For  simplicity,  we  consider  the  non¬ 
negative  orthant  (it  also  holds  for  any  simple  polyhedral  domain  by  a  change 
of  coordinates).  In  this  setting  N  =  N  =  I  and  Q  =  Q,  but  we  continue  to 
use  the  bar  notations  for  convenience.  Here  we  do  not  assume  a  priori  that 
the  data  satisfies  the  skew-symmetry  condition. 

Claim  2:  Given  Q  £  M.JxJ  that  has  zero  on  the  diagonal,  and  a  nonde¬ 
generate  covariance  matrix  A  £  WJxJ,  suppose  there  exists  an  invertible 
symmetric  matrix  (7*  such  that  the  C2  function  p(x)  =  ex  ('rX  solves  the 
adjoint  PDE  associated  with  ( I,Q ),  A,  and  b(x)  =  [A  —  Q\C*x.  Then  Q 
must  be  skew-symmetric. 

Proof  of  Claim  2:  Indeed,  suppose  that  such  an  invertible  symmetric  ma¬ 
trix  (7*  exists.  Then,  by  Corollary  1,  equation  (21)  should  be  satisfied  by 
H(x)  =  xTC*x  and  b(x)  =  [A  —  Q](7* x.  In  other  words,  it  follows  that  for 
each  x  £  G, 

V  •  (AC*x)  +  ((7*x,  AC*x)  -  V  •  ([H  —  Q]C*x)  -  (C*x,  [A  -  Q]G*x)  =  0, 
which,  since  V  •  (QC^x)  =  tr(QC *),  is  equivalent  to 

tr(QC *)  +  (C*x,  QC*x)  =  0. 

Now,  fix  y  £  G.  Then  for  any  x  £  RJ,  for  all  e  small  enough,  we  have 
y  +  ex  £  G.  Substituting  y  and  y  +  ex  into  the  above  display  and  taking  the 
difference,  we  have 

(30)  e(C*y,  QC*x)  +  e(C*x,  QC*y)  +  e2(C*x,  QC*x)  =  0. 

Dividing  the  above  display  by  e  and  taking  the  limit  as  e  — >•  0,  we  have 
{C*y,  QC*x)  +  (<7*x,  QC*y)  =  0. 

Substituting  this  back  into  (30),  we  have  shown  that  for  every  x  £  MJ, 

(C*x,  QC*x)  =  0. 

Since  C*  is  invertible,  this  shows  that  Q  is  skew  symmetric. 

Example  3.11.  We  note  that  solutions  to  the  equations  (21)  and  (22) 
are  preserved  under  linear  combinations.  More  precisely,  suppose  for  m  £  N, 
each  pair  (&,;,  Ht).  i  =  1, . . . ,  m,  satisfies  the  pair  of  equations  (21)  and  (22). 
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Then,  for  any  A*  £  M,  i  =  1,  2,  •  •  •  ,  rn,  the  pair  (X^i  Y^Li  Hi)  also 
satisfy  the  same  pair  of  equations.  Thus,  taken  together,  the  above  examples 
identify  a  general  class  of  drift  vector  fields  whose  adjoint  has  a  solution  of 
Gibbs  form  with  potential  being  a  quadratic  form.  For  example,  if  (TV,  Q),  A 
satisfies  the  global  skew-symmetric  condition  (24)  and  the  Jacobian  of  the 
skew-transform  of  the  drift  b(-)  is  a  constant  symmetric  matrix,  that  is, 
[A  —  N~1Q]~1b(x)  =  C*x  +  /x*  for  some  symmetric  matrix  C*  and  some 
constant  vector  /j* .  Then  b(x)  =  Cx  +  p.  where  C  =  [A  —  N~1Q]C„:  and 
H  =  [A  —  N~1Q ]/x*.  By  combining  Examples  3.9  and  3.10,  the  adjoint  PDE 
with  drift  b(x)  =  Cx  +  p  has  a  strictly  positive  solution  p(x)  =  eH^x\  where 
H[x)  =  xTC*x  +  (p*,x). 

4.  Examples.  In  this  section,  we  provide  several  examples  of  reflected 
diffusions  in  piecewise  C 1  domains  with  continuous  reflection  for  which  the 
submartingale  problem  is  well  posed  and  Assumption  2  is  satisfied,  so  that 
Theorems  1  and  2  provide  a  characterization  of  their  stationary  distribu¬ 
tions.  The  examples  serve  to  illustrate  the  range  of  applicability  of  the  results 
of  the  paper.  The  first  and  fourth  examples  consider  families  of  semimartin¬ 
gale  reflected  diffusions,  whereas  the  remaining  examples  describe  reflected 
diffusions  that  could  fail  to  be  semimartingales.  The  last  example  involves  a 
cusp-like  domain  that  was  specifically  identified  in  [47]  as  a  two-dimensional 
example  not  covered  by  the  methods  therein.  To  the  best  of  our  knowl¬ 
edge,  prior  to  this  work,  there  existed  no  characterization  of  the  stationary 
distribution  of  the  processes  described  in  Examples  4.3,  4.5,  4.6  and  4.7. 

Example  4.1  (Reflected  diffusions  in  smooth  domains).  We  start  with 
the  simple  case  of  reflected  diffusions  in  smooth  domains  addressed  in  [47]. 
Let  G  be  a  bounded  open  set  in  such  that  G  =  {i£  :  (j)(x)  >  0}, 

where  (f)  £  C^(RJ)  and  |V^>|  >  1  on  dG.  Then  V(/>(.x)  is  an  inward  normal 
vector  at  x  £  dG.  Let  y(-)  be  a  bounded  Lipschitz  continuous  vector  field 
that  satisfies  (V(j>(x),'y(x)}  >  0  on  dG.  By  [43]  (see  Theorems  3.1  and  5.4 
therein)  the  associated  submartingale  problem  with  C  as  in  (1)  and  V  =  0 
is  well  posed.  Now,  (G,d(-))  is  a  C 1  domain  with  continuous  reflection  and, 
since  U  =  dG ,  Assumption  2  is  trivially  satisfied  with  V  =  0. 

Example  4.2  (RBM  in  a  2-dimensional  wedge).  Consider  a  wedge  G  C 
M2  given  in  polar  coordinates  by 

G  =  {( r,6 )  :  0  <  6  <  C,  r  >  0}, 

where  C  £  (0,  n)  is  the  angle  of  the  wedge.  Then  G  admits  the  representation 
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G  =  Gi  Cl  G2 ,  where  G±  and  G-2  are  the  two  half  planes 

G\  =  {(r,  9)  :  0  <  6  <  it,  r  >  0}, 

G2  =  {(r,0)  :  (  -  it  <  9  <  (,  r  >0}, 

whose  unit  inward  normals  we  denote  by  n1  and  n2,  respectively.  Let  the 
directions  of  reflection  on  dG±  and  8G2  be  specified  as  constant  vectors 
71  and  y2,  normalized  such  that  for  j  =  1,2,  (7 =  1.  For  j  =  1,2, 
define  the  angle  of  reflection  9j  to  be  the  angle  between  n-7  and  7-?,  such 
that  9j  is  positive  if  and  only  if  7-?  points  towards  the  origin.  Note  that 

— 7r/2  <  9j  <  7t/2.  Define  a  =  (9\  +  02)/(.  It  was  proved  in  Theorem  3.10 

of  [46]  that  the  submartingale  problem  with  C  =  and  V  =  {0}  is  well 
posed  if  and  only  if  a  <  2.  Since  dG  \  U  C  V  and  V  contains  only  one 
element,  Assumption  2  holds.  Note  that  when  a  G  [1,2),  the  RBM  is  not  a 
semimartingale. 

Example  4.3  (RBM  in  a  2-dimensional  polygon).  Consider  a  two  di¬ 
mensional  polygon  G  C  R2  with  vertices  cli,...,clk  (in  counterclockwise 
order) .  For  k  =  1 , . . . ,  K  —  1 ,  define  side  k  as  the  open  line  segment  be¬ 
tween  cifc  and  afe+i-  Similarly,  side  K  is  the  line  segment  between  ax  and 
ai,  excluding  the  endpoints.  Let  denote  the  interior  angle  made  by  the 
two  sides  meeting  at  vertex  a k  .  Also  given  are  angles  9 1 , . . . ,  9k  satisfying 
\9f;\  <  7t/2  which  will  determine  the  directions  of  reflection  on  each  side.  For 
each  k  =  1 , ,K,  9 &  is  the  angle  between  the  inward  normal  nk  and  the 
constant  direction  of  reflection  associated  with  side  k  and  Ok  is  positive  if 
and  only  if  points  towards  the  vertex  cik+i-  It  was  established  in  Theorem 
3.7  of  [22]  that  when  9k- 1  <  9k  +  2£k  for  all  k  =  1, ... ,  K,  the  submartingale 
problem  with  C  =  ^ A  and  V  =  {ai,...,a/j}  is  well  posed.  Note  that  at 
each  vertex  a&,  there  exists  a  unit  vector  vak  such  that  {vak,  7?'_1)  >  0  and 
(vak,  7fc)  >  0.  In  addition,  dG\U  C  V.  Thus,  Assumption  2  holds.  Note  that 
if  there  exists  k  such  that  (9k- i  —  9k) /Ck  £  [1,2),  then  the  associated  RBM 
is  not  a  semimartingale.  A  subclass  of  these  RBMs,  which  arise  as  diffusion 
approximations  of  closed  networks,  were  also  investigated  in  [40]. 

Example  4.4  (SRBM  in  polyhedral  domains).  We  now  describe  a  class 
of  semimartingale  RBMs  (SRBMs  for  short)  that  arise  as  diffusion  ap¬ 
proximations  of  queueing  networks  [50].  In  this  case,  G  =  is  the  non¬ 
negative  orthant  in  R^,  which  admits  the  representation  G  =  1  Gi,  where 

Gi  =  {x  €  RJ  :  £c*  >  0},  and  the  direction  vector  field  'f  on  Gi  is  a  con¬ 
stant  vector  field,  pointing  in  a  direction  dl  G  R^.  Moreover,  the  matrix  D 
with  column  dl  is  assumed  to  satisfy  the  completely-5  condition,  which  im¬ 
plies  that  U  =  dG.  It  was  shown  in  [45]  that  the  reflected  Brownian  motion 
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associated  with  G  and  d(  )  admits  a  weak  solution  that  is  unique  in  law. 
Therefore,  by  Theorem  2  of  [28]  it  follows  that  the  submartingale  problem 
with  C  =  ijA  and  V  =  0  is  well  posed.  By  Remark  3.4,  Assumption  2  is 
trivially  satisfied  with  V  =  0. 

Example  4.5  (Nonsemimartingale  reflected  diffusions  in  polyhedral  do¬ 
mains).  Here,  we  first  consider  a  class  of  RBMs  that  were  shown  in  [16,  17, 
18,  36,  37]  to  arise  as  reflected  diffusion  approximations  of  multiclass  queue¬ 
ing  networks  using  the  so-called  generalized  processor  scheduling  policy  that 
is  used  in  high-speed  networks  for  efficient  sharing  of  resources  amongst  traf¬ 
fic  of  different  classes.  The  state  space  G  associated  with  the  GPS  ESP  has 
the  representation 


J+ 1 

G  =  P|  {r  G  1J  :  (x,  nl )  >  0}, 

i=  1 

where  nl  =  for  i  =  1,...,J  (here  {ei,i  =  1,...,J}  is  the  standard 
orthonormal  basis  in  M^)  and  nj+\  =  'Yhl=\  ei/ V* J ■  The  reflection  vector 
field  is  piecewise  constant  on  each  face,  governed  by  the  vectors  {7*,  i  = 
1  ,...,</  +  1}  that  are  defined  as  follows:  7J+1  =  Yli=iei/'^  and  {7*, i  = 
1, . . . ,  J}  are  defined  in  terms  of  a  “weight”  vector  a  G  that  satisfies 
a,i  >  0  for  each  i  =  1, ...,  J  and  Yli= 1  =  1;  f°r  *,  j  =  1,  •  •  • ,  J, 

- - ^zr-  for  j  f  l, 

1  -  Oii 

1  for  j  =  i. 

The  fact  that  the  associated  stochastic  differential  equation  with  reflection 
has  a  pathwise  unique  solution  follows  from  Corollary  4.4  of  [35].  Hence, 
well-posedness  of  the  submartingale  problem  with  C  as  in  (1)  and  V  =  {0} 
follows  from  Theorem  2  of  [28].  Moreover,  Lemma  3.4  of  [35]  shows  that 
dG  \  U  =  V  =  {0}  and  V  only  contains  one  element.  Hence,  Assumption  2 
holds.  It  was  shown  in  [26]  that  this  process  is  not  a  semimartingale.  The 
two-dimensional  case  corresponds  to  the  case  a  =  1  and  (  =  it / 2  in  Example 
4.2. 

Example  4.6  (Nonsemimartingale  RBMs  in  curved  domains).  We  now 
consider  a  class  of  reflected  diffusions  in  curved  domains  introduced  by  Bur- 
dzy  and  Toby  in  [7].  Suppose  that  L  and  R  are  twice  continuously  differ¬ 
entiable  real  functions  defined  on  M  and  such  that  L( 0)  =  R( 0)  =  0  and 
L(y)  <  R(y)  for  all  y  >  0.  The  domain  has  the  form  G  =  G±  n  G2  n  G3, 
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where 


Gi  =  {(x,y)  :  x  >  L(y)},  G2  =  {(x,y)  :  x  <  R(y)}, 

G3  =  {( x,y )  :  y>  0,i6i}. 

For  j  =  1,  2,  3  and  z  G  d Gj,  let  nJ(z )  denote  the  unit  inward  normal  vector 
to  dGj  at  z.  Let  71(-)  =  (1,0)',  y2(-)  =  (—1,0)'  and  y3(-)  =  (0,1)'.  In  [7] 
the  RBM  in  such  a  domain  was  characterized  as  the  pathwise  unique  strong 
solution  to  the  associated  stochastic  differential  equations  with  reflection. 
Using  techniques  similar  to  Theorem  2  of  [28],  it  can  be  shown  that  the 
associated  submartingale  problem  with  £  =\ A  and  V  =  {0}  is  well  posed, 
and  Proposition  4.13  of  [6]  shows  that  the  process  is  not  a  semimartingale. 
Since  U  =  dG  \  V,  and  V  is  a  singleton,  Assumption  2  is  trivially  satisfied. 

Example  4.7  (RBMs  in  Cusp-like  domains).  Consider  a  two-dimensional 
domain  G  with  representation 

G  =  {(x,y)  :  x  >  0,  —  x@  <  y  <  x ^},  (3  >  1. 

The  domain  G  has  a  cusp  at  the  origin  and  G  =  G\  Cl  G2,  where 

G i  =  {(.x,  y)  :  y  <  x13  when  x  >  0  and  y  <  0  when  x  <  0}, 

G2  =  {(x,  y)  :  y  >  —x13  when  x  >  0  and  y  >  0  when  x  <  0}. 

For  each  j  =  1,  2,  and  z  G  dGj ,  let  n3  {z)  be  the  inward  unit  normal  vector 
to  dGj  and  let  7 J{z)  make  a  constant  angle  9j  G  ( — vr/2,  7t/2)  with  nJ{z).  We 
take  9j  >  0  if  and  only  if  the  first  component  of  7 3{z)  is  negative,  that  is, 
7J  (z)  points  towards  the  origin  for  2:  in  a  small  neighborhood  of  the  origin. 
Since  9j  7^  ±vr/2,  we  can  without  loss  of  generality  assume  the  normaliza¬ 
tion  (^(z),  nJ(z))  =  1  holds.  It  was  proved  in  [12]  that  the  submartingale 
problem  with  V  =  {0}  is  well  posed  when  9\  +  92  <  0.  It  is  easy  to  check 
that  dG  \  U  C  V  and  V  contains  only  one  element,  and  thus  Assumption  2 
holds. 

5.  Sufficiency  of  the  Inequality  Condition.  Throughout  this  sec¬ 
tion,  assume  (G,d(-)),  b(-),  cx(-)  and  a  finite  set  V  C  dG  are  associated 
with  a  well-posed  submartingale  problem.  Let  ir  be  a  probability  measure 
on  (G,  13(G))  such  that  ir(dG)  =  0.  In  this  section  we  show  that  if  n  also 
satisfies  (2)  for  every  /  G  T~L,  then  n  is  a  stationary  distribution  for  the 
well-posed  submartingale  problem.  The  proof  consists  of  three  main  steps. 
First,  in  Section  5.1  (see  Proposition  5.1)  we  show  that  the  inequality  (2) 
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is  equivalent  to  a  certain  generalized  basic  adjoint  relation  (BAR).  Next,  in 
Section  5.2,  we  use  the  generalized  BAR  to  deduce  the  existence  of  a  station¬ 
ary  process  X  that  has  marginals  equal  to  n  and  satisfies  some  additional 
properties.  We  complete  the  proof  in  Section  5.3  by  showing  that  the  law 
of  X  is  equal  to  Qw,  the  solution  to  the  well-posed  submartingale  problem 
with  initial  distribution  n. 

5.1.  A  Generalized  Basic  Adjoint  Relation.  In  what  follows,  let 

(31)  /Ci  =  {(x,  u )  G  M2J  :  x  G  d G  \  V,  u  G  d{x),  |w|  =  1}. 

Proposition  5.1.  Let  (G,  d(-)),b(-),  a(-)  and  a  finite  set.V  be  associated 
with  a  well-posed  submartingale  problem  and  suppose  that  the  associated  set 
Li  defined  in  (3)  satisfies  Assumption  1.  Given  any  probability  measure  n  on 
G  that  satisfies  ir(dG)  =  0,  it  satisfies  the  inequality  (2)  if  and  only  if  there 
exists  a  a -finite  ( nonnegative )  Borel  measure  p  on  LC\  such  that 

(32)  /  Cf{x)Tr{dx)  +  /  (tt,V  f  (x)) p,(dx ,  du)  =  0  for  each  f  G  LL. 

Jg  JKi 

Proof.  The  fact  that  (32)  implies  (2)  is  immediate  because  /i  is  a  non¬ 
negative  measure,  and  /  G  LL  implies  (u,Xf(x))  >  0  for  ( x,u )  6  K,\. 

We  now  prove  the  converse.  Suppose  tt  satisfies  (2)  and  let  K,  =  tC\  U/C2, 
where  /Ci  is  defined  in  (31)  and 

JC 2  =  {( x,u )  G  M2J  :  iGG,  |it|  =  1}. 

For  each  f  £  LL,  let  hf  :  K,  4  1  be  the  function  given  by  hf(x,u )  = 
(u,Vf(x)}  for  each  ( x,u )  G  1C.  Clearly,  hf  G  C^(/C)  for  each  f  e  LL.  Let  % 
be  the  linear  subspace  of  Cc(LC)  given  by 

%  =  I#  G  Clc(lC)  :  g  =  T  oth*,  n  G  N,  fi  G  LL,  a*  G  M,  i  =  1, . . . ,  n|  , 

and  for  each  g  G  To  that  has  a  representation  of  the  form  g  =  ^)”=1 
define 

(33)  A  (g)  =  -f_£^ 

We  now  show  that  the  value  of  A  (g)  does  not  depend  on  the  chosen  rep¬ 
resentation  for  g.  Suppose  we  are  given  two  representations  of  g  G  To  with 


'y  ^ 


(x)n(dx) 


i=  1 
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g  =  Y^=  l  aihfi  =  Sjl i  bjhj..  Then,  by  the  definition  of  hf, 


u, 


V 


(u,V  (x)^  ,  x  eG,  \u\  =  1. 


This  implies  that  V(^“=1  aifi)(x)  =  ^(Yl'jLi^jfj)(x)  f°r  any  x  £  G,  and 

hence  £(Y17=  l  aifi)(x )  =  £(YljL l  bjfj)(x )  f°r  any  x  £  G.  Since  7 r(dG)  =  0, 
the  right-hand  sides  of  (33)  for  the  two  representations  coincide.  Thus,  A  is 
well  defined. 

We  show  below  that  A  is  in  fact  a  positive  linear  functional  on  7o  with 
respect  to  a  suitable  partial  order.  Linearity  of  A  trivially  follows  from  the 
definition.  Let 


V  =  {g  £  Cc(/C)  :  0  <  g(x,  u )  <  hf(x,u),  (x,  u)  £  /Ci  for  some  /  £  %}. 

Since  the  mapping  from  /  to  hf  is  linear  by  the  definition  of  hf,  it  is  easy 
to  verify  that  (1)  g,g  £  V  implies  g  +  g  £  V',  and  (2)  g  £  P  and  a  >  0 
implies  ag  £  V.  Thus,  V  is  a  positive  cone  in  Cc(/C).  On  Cc(/C),  we  consider 
the  partial  order  <  defined  by  h  <  g  if  g  —  h  £  V.  To  show  that  A  is 
positive  on  To,  let  g  £  TqC\V.  Since  g  £  7o,  it  admits  a  representation  of 
the  form  g  =  X^=i  ai^fi  f°r  some  £  M,  fi  £  "H.  Since  each  /)  £  %,  clearly 
SILi  aifi  £  C^(G)©M.  Moreover,  g  &  V  implies  g  >  0,  which  in  turn  implies 
(it,  fi(x)}  >  0  for  each  x  £  (9G  \  V  and  u  £  d(x)  with  |u|  =  1.  As 

a  consequence,  Yl?=iaifi  ^  By  (2)  and  (33),  this  implies  that  A (g)  >  0 
which  shows  that  A  is  positive. 

We  now  verify  an  additional  condition  that  will  allow  us  to  apply  a  version 
of  the  Hahn-Banach  theorem. 

Claim  1.  For  each  h  £  Cc(/C),  there  exists  g  £  To  such  that  g  —  h  £  V. 

Proof  of  Claim  1.  Fix  h  £  Cc(JC).  Then  there  exists  a  compact  set  K  C  K. i 
and  a  constant  0  <  C  <  oo  such  that  \h{x,  it)|  <  CIk(x,  u)  for  each  (x,  it)  £ 
/C i-  We  can  assume  without  loss  of  generality  that  there  exist  r,s  >  0  such 
that 

(34)  {x  £  MJ  :  (x,  it)  £  K}  C  {x  £  8G  :  |x|  <  r,  d(x,  V)  >  s}. 

Let  /  =  C fr,si  where  fr.s  £  %  C\C^{G)  is  the  function  from  property  2  of 
Assumption  1.  Then  clearly  \h(x,u)\  <  CIk(x,u )  <  hf(x,u )  =  (it,  V/(x)) 
for  each  (x,  it)  £  K,\.  Choose  g  =  hf.  Then  g  £  To,  0  <  g  —  h  <  2hf  =  h^f 
on  /Ci,  and  2/  £  'LL.  Thus,  g  —  h  £  V .  This  establishes  the  claim. 

By  the  claim  and  an  application  of  the  positive  cone  version  of  the  Hahn- 
Banach  theorem  (cf.  Theorem  2.1  of  [3]),  A  can  be  extended  to  a  positive 


33 


30 


W.  N.  KANG  AND  K.  RAMANAN 


linear  functional  on  Cc(IC).  which  we  denote  again  by  A.  An  application 
of  the  Riesz  representation  theorem  then  shows  that  there  exists  a  unique 
regular  Borel  measure  g  on  K,  such  that 

(35)  A (g)  =  /  g(x,u)g(dx,  du)  for  each  g  E  Cc(lC). 

JK 

Now,  for  each  g  £  Cc(K,2 ),  both  g  and  —g  are  identically  zero  on  K, \  and 
hence  lie  in  V.  Therefore,  A (g)  =  0  for  every  g  £  Cc{lC 2),  which  in  turn 
implies  g(K,2)  =  0.  Now,  for  /  £  "H,  substituting  g  =  hf  £  7o  into  both 
the  definition  (33)  and  the  representation  (35)  of  A,  and  using  the  fact  that 
MA2)  =  0,  we  obtain  (32). 

To  see  that  g  is  a  sigma-finite  measure,  fix  any  constant,  say  (7  =  1,  and 
a  compact  subset  K  C  KL\.  Let  r,  s  >  0  be  such  that  (34)  holds,  and  let 
/  =  fr,s  £  Td  be  the  function  from  Assumption  1(2).  Then  hf  £  7o,  and 
substituting  /  in  (32),  we  obtain 

g(K)  <  /  hf(x,  u)g(dx,  du)  =  —  /  £f(x)du<  00, 

JlCx  Jg 

where  finiteness  of  the  last  integral  holds  because  Cf  is  continuous  and  has 
compact  support  in  G.  □ 


Remark  5.2.  When  V  /  0  the  condition  in  (32),  which  we  will  refer 
to  as  the  generalized  BAR,  is  somewhat  more  subtle  than  the  usual  BAR 
that  has  been  established  for  semimartingale  RBMs  in  the  orthant  [23].  In 
the  latter  setting,  the  measure  g  in  the  BAR  is  a  finite  measure  that  is 
absolutely  continuous  with  respect  to  the  local  time  measure  dL  associated 
with  the  RBM  Z  on  the  boundary  dG,  and  takes  the  form 


g(A)  = 


\z(u)&A}dL(u)  , 


A  £  B(Rd). 


However,  when  V  /  0,  the  local  time  is  typically  not  of  bounded  variation 
[26,  35],  and  so  the  local  time  does  not  define  a  finite  measure  on  the  bound¬ 
ary.  However,  since  increments  of  the  local  time  when  the  process  is  away 
from  the  set  V  can  be  shown  to  be  of  bounded  variation  [35],  one  can  still 
associate  a  cr-finite  measure  g  which  is,  roughly  speaking,  associated  with 
the  local  time  of  excursions  of  the  reflected  diffusion  away  from  the  set  V. 
Since  functions  in  Ti  are  constant  in  a  neighborhood  of  V,  the  condition 
(32)  is  satisfied.  This  emphasizes  the  subtlety  in  the  correct  choice  of  test 
functions  for  characterization  of  the  stationary  distribution. 
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5.2.  Existence  of  a  Stationary  Process.  We  now  establish  a  corollary  of 
the  generalized  BAR,  the  proof  of  which  relies  on  the  following  approxima¬ 
tion  lemma.  For  f  E  PL,  the  limit  lim|x|_s.00  f(x)  clearly  exists,  and  in  what 
follows,  we  denote  it  by  /( oo). 


Lemma  5.3.  The  set  PL  has  a  countable  subset  PLq  with  the  property  that 
for  each  f  G  PL  and  each  N  G  N  such  that  Bn(0)  contains  both  an  open 
neighborhood  ofV  and  an  open  neighborhood  o/supp(/ — /(oo)),  there  exists 
a  sequence  {gk  '■  k  G  N}  C  "Ho  such  that 
(36) 


lim  sup 

k^°°  xeGnBN(o) 


max\f(x)-gk(x)\V 

*j=i 


d  f(x) 

dgk{x) 

V 

d2f(x) 

d29k(x) 

dxi 

dxi 

dxidxj 

dxidxj 

=  0. 


Moreover,  the  above  property  also  holds  with  the  set  V  =  {/  G  PL  :  f  >  0} 
in  place  of  PL  and  a  countable  subset  Vq  in  place  ofPLo- 


The  proof  of  Lemma  5.3  relies  on  the  denseness  of  polynomials  in  C2(RJ) 
and  standard  mollification  arguments,  and  hence  is  deferred  to  Appendix  A. 


Corollary  3.  Let  the  conditions  of  Proposition  5.1  be  satisfied.  Then 
there  exists  a  stationary  process  X  whose  law  on  ( C  [0,  oo) ,  M),  satisfies 
the  following  properties: 

1.  The  law  of  uj( 0)  under  is  tt; 

2.  For  every  f  G  PL,  the  process 

f(u(t))-[  £f(u{u))du ,  t  >  0, 

Jo 


3. 


is  a  Qn- submartingale  on  ( C  [0,oo) ,  A4,  {Mt}); 


U  o 


Iv(w(s))  ds 


=  0. 


Proof.  Let  g  be  the  non-negative  c-hnite  measure  specified  in  Proposi¬ 
tion  5.1,  and  extend  g  from  K,  to  a  a-hnite  measure  on  G  x  S'i(O)  by  defining 
g(G  x  Si(0)  \  /C)  =  0.  In  the  rest  of  the  proof,  we  use  g  to  denote  this  ex¬ 
tension.  Since  g  is  u-hnite,  it  follows  that  there  exists  a  continuous  function 
4>  defined  on  G  x  Si(0)  that  satisfies  f(x,  u)  G  (0, 1)  for  each  igG\V  and 
u  G  Si(0)  and  JqxSi^  <f>(x,u)g(dx,  du)  <  oo. 

We  will  establish  the  corollary  by  verifying  the  assumptions  of  Theorem 
1.7  of  [30].  We  first  show  that  the  five  clauses  of  Condition  1.2  of  [30]  are 
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satisfied  with  V  =  {/  G  H  :  f  >  0},  E  =  G,  U  =  S\  (0).  and  operators  A 
and  B  from  V  C  Cb(G )  to  C(G  x  S'i(O)),  that  are  defined  as  follows: 

Af(x,  u)  =  Cf(x)  and  Bf(x,u)  =  1  ( u,Vf(x )). 

<P\x,u) 

Clearly,  1  6  P  and  A1  =  B1  =  0.  Thus,  (i)  of  Condition  1.2  of  [30]  holds. 
Let  if A  =  ipB  =  1-  Note  that  for  each  function  /  e  V,  V/  is  zero  outside  a 
compact  set  Kf  C  G  \  V  and  /,  V/  and  (due  to  the  continuity  of  the  drift 
and  dispersion  coefficients)  Cf,  are  all  uniformly  bounded  on  G,  say  by  a 
constant  aj  <  oo.  Hence,  \Af(x,u)\  <  cif  =  afipA{x,u)  and  \Bf(x,u)\  < 
bf  =  bf^Bix^u)  for  every  (x,u)  eGx  <Si(0),  where 


which  is  finite  because  0  <  ^>  <  1  by  construction,  and  the  infimization 
can  be  replaced  by  a  minimization  since  <f>  is  continuous  and  Kf  x  S'i(O) 
is  compact.  It  follows  from  the  second  part  of  Lemma  5.3  that  the  set 
{(/,  Af,  Bf)  :  f  e  V}  is  separable  in  the  sense  that  there  exists  a  countable 
subset  Vq  C  V  such  that  the  set  {( f,Af,Bf )  :  /  e  V}  is  contained  in 
the  bounded,  pointwise  closure  of  the  linear  span  of  {(/,  Af,  Bf)  :  f  G  Vq}. 
This  verifies  (iii)  of  Condition  1.2  of  [30].  From  the  definitions  of  A  and  B, 
it  clear  that  (iv)  of  Condition  1.2  of  [30]  is  also  satisfied  (see,  for  instance, 
Example  1.4  of  [30]).  Lastly,  it  is  clear  that  V  is  closed  under  multiplication. 
Also,  by  1  of  Assumption  1,  T~i  separates  points,  and  since  for  any  f  £  H 
and  c  >  0,  /  —  min,g]Rj  f(z)  +  c  G  T> ,  V  also  separates  points.  Thus,  the  last 
property  of  Condition  1.2  of  [30]  follows. 

We  next  define  two  measures  on  G  x  S'i(O).  Let  r) o  be  the  unique  rota- 
tionally  invariant  probability  measure  on  S\  (0)  and  let  fio  be  the  probability 
measure  on  G  x  Si(0)  given  by 

fj>o(dx,du)  =  7~io(du)ir(dx). 

Then  for  each  /  €  V,  we  have 


bf  =  sup 

x€G,ugSi(0) 


|V/(*)| 


*-x£Kf,u£Si  (0) 


/Gx5i(0) 


Af(x,u)fio(dx,du)  = 


/  Cf(x)^io(dx,du)=  /  Cf(x)ir(dx). 

'GxSi(O)  Jg 


Also,  let  fi\  be  the  finite  measure  on  G  x  Si(0)  given  by 


Hi  (dx,du)  =  <p(x,u)ii(dx,du). 
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It  is  clear  that 


/  ipA{x,u)no(dx,du)  +  /  ^b(x,  u)ni(dx,  du)  <  oo 

JGxSi(0)  JGxSi(O) 

and  by  (32),  for  each  /  G  V  C  TL, 


'GxSi  (0) 


Af(x,  u)fio(dx,  du)  + 


[  Cf(x)ir(dx) 
Jg 


+ 


'GxSi(O) 


Bf( x,  u)m{dx ,  du) 


/GxSi(O) 

(w,  V  f  {x)) n{dx ,  du)  =  0. 


Let  U  =  G  x  S\  (0).  Obviously,  Hi(U)  =  /i,(G'  x  £i(0))  for  i  =  0, 1.  We 
have  verified  all  the  assumptions  of  Theorem  1.7  of  [30],  and  so  it  fol¬ 
lows  from  that  theorem  that  there  exists  a  stationary  process  X  such  that 
77(0)  has  distribution  n  and  {f(X(t))  —  Jo  fBl(o)  Af(X(s),u)r/o(du)ds,t  > 

0}  =  (f(X(t))  —  f*£f(X(s))ds,t  >  0}  is  a  submartingale  for  each  /  G  V. 
Since  /  —  minxeRj  f(x)  6  V  for  each  /  G  77,  it  follows  that  {f(X(t))  — 
f*£f(X(s))ds,t  >  0}  is  a  submartingale  for  each  /  G  77.  To  conclude  the 
proof,  we  note  that  by  the  stationarity  of  X,  the  assumption  n (dG)  =  0  and 
the  fact  that  77(0)  has  distribution  7 r, 


E 


Iv{X(s))ds 


L-V0 


E  [Iv(7l  (s))]  ds 


ir(V)ds  =  0. 


The  above  discussion  shows  that  Qn,  the  law  of  X,  satisfies  the  three  prop¬ 
erties  stated  in  the  corollary.  □ 


5.3.  Proof  of  Theorem  1.  The  necessity  of  the  condition  (2)  follows  from 
the  discussion  prior  to  the  statement  of  Theorem  1.  So,  it  only  remains 
to  prove  sufficiency.  If  (2)  and  the  assumptions  of  the  theorem  hold,  then 
by  Corollary  3  there  exists  a  stationary  process  X  whose  law,  satisfies 
the  three  properties  stated  therein.  To  complete  the  proof  of  Theorem  1  it 
only  remains  to  show  that  (QL  is  equal  to  (Q^,  the  solution  to  the  well-posed 
submartingale  theorem. 

For  each  co  G  C  [0,  oo),  let  Q u  be  a  regular  conditional  probability  distri¬ 
bution  of  (QL  given  M.q.  Then,  for  each  cu  G  C  [0,  oo), 

(37)  4,(w'(0)  =  w(0))  =  1. 

Moreover,  disintegrating  and  using  property  1  of  (QL,  we  obtain 

(38)  4r(-)=  [  <L  (-)4r(<M=  /  (LOF’W, 

J  C[  0,oo)  J  C[  0,oo) 
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where  P71"  is  the  probability  measure  on  (C  [0,  oo)  ,Mo)  obtained  as  the  re¬ 
striction  of  Q,,-  to  A4o  defined  as  follows:  for  Ao  G 

(39)  P^(A)  =  7r(A0nG),  if  A  =  {uj  G  C  [0,  oo)  :  w(0)  G  A0}. 


It  then  follows  from  property  3  of  that 


(40)  0  =  E^ 

■  /*oo 

/  Iy(w(s))  d-s 

=  f 

‘  /»oo 

/  Iy(u/(s))  ds 

Jo 

Jc[0,oo) 

Jo 

For  each  AgN,  consider  the  stopping  time 

(41)  XN(U)  =  inf{f  >  0  :  u(t)  £  -Bjv(O)},  uj  G  C  [0,  oo) , 


where  we  adopt  the  convention  that  the  infimum  over  an  empty  set  is  in¬ 
finity.  Let  Ho  be  the  countable  subset  of  H  described  in  Lemma  5.3.  By 
property  2  of  Qtt  and  the  optional  stopping  theorem,  {f(uj(t  A  XN(U})))  — 
jtA\  (uj)  du,  t  >  0}  is  a  (QL-submartingale  for  each  /  G  Ho- 

By  (38)  and  the  fact  that  Ho  is  countable,  there  exists  G  M.o  with 
F-(Ff  )  =  0  such  that  for  every  uj  ^  F^  and  each  /  G  Ho,  {f(uj'(t  A 
XN(v')))  —  /oAv  ^  Cf(ui'(u))  du,  t  >  0}  is  a  Q^-submartingale.  Since 
functions  in  H  are  bounded  and,  by  Lemma  5.3,  can  be  approximated 
by  functions  in  Ho,  it  follows  that  for  every  uj  ^  and  each  /  G  H, 

{f(uj'(t  A  xN(U}>)))  ~  CX  ^  ^  F ))  du,  t  >  0}  is  a  Q^-submartingale. 
Let  Fo  =  UNF*  U  {uj  :  xN{^)  Jr  °°}-  Then  IP^Fo)  =  0  and  for  each 
uj  ^  Fo  and  /  G  H,  by  passing  to  the  limit  as  N  -A  oo,  we  conclude  that 
{/(a/(i))  —  Jq  Cf{uj' (u))  du,  t  >  0}  is  a  Q^-submartingale.  In  addition,  by 
(40),  without  loss  of  generality  by  enlarging  Fo  to  another  P^-null  set,  we 
may  assume  that  for  each  uj  ^  Fq, 


jgQw 


Uo 


Iy(u/(s))  ds 


=  0. 


Thus,  for  each  uj  ^  Fq,  we  see  that  Qu  satisfies  all  three  properties  of  Defini¬ 
tion  2.1  with  z  =  ca(0).  By  the  well-posedness  of  the  submartingale  problem, 
this  implies  that 


Quj  —  Qu(  o) 


and  then  by  (38)  and  (39), 


&r(0  = 


/C[0,oo) 


Qcj(0){-)^w  (duj)  =  _Qz(-)TT(dz)  =  Qn(-). 


>G 


This  shows  that  Qn  =  Qn  and  completes  the  proof  of  Theorem  1. 
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6.  A  Boundary  Property.  The  main  result  of  this  section  shows  that 
for  a  large  class  of  domains  and  reflection  fields  (G,  d(-))  and  subsets  V  C  dG 
associated  with  a  well-posed  submartingale  problem,  the  solution  to  the  sub¬ 
martingale  problem  spends  zero  Lebesgue  time  on  the  boundary  of  the  do¬ 
main.  In  this  section  for  simplicity  we  assume  that  the  uniform  ellipticity 
condition  (12)  holds.  The  boundary  property  is  first  stated  precisely  in  Sec¬ 
tion  6.1  (see  Proposition  6.1),  and  its  proof,  which  is  given  in  Section  6.3,  is 
preceded  by  some  supporting  results  that  are  established  in  Section  6.2. 


6.1.  Statement  of  the  Boundary  Property.  We  state  the  boundary  prop¬ 
erty  and  show  that  it  is  equivalent  to  the  property  stated  in  (47)  below. 


Proposition  6.1.  Suppose  that  ( G,d( •))  is  a  piecewise  C2  domain  with 
continuous  reflection,  V  C  dG  satisfies  dG  \  U  C  V  and  the  submartingale 
problem  associated  with  (G,d(-)),  V,  b(-)  and  a(-)  is  well  posed.  If  {Qx,x  £ 
G}  is  the  solution  to  the  associated  submartingale  problem,  then  for  each 
x  £  G, 


(42) 


JgQai 


IsgMs))  ds 


=  0. 


Due  to  property  3  of  the  subnrartingale  problem  and  the  assumption  that 
dG  \  U  C  V,  to  show  (42)  it  suffices  to  show  that  for  each  x  £  G, 


(43) 


JgQai 


L4o 


IwMs))  ds 


=  0. 


Without  loss  of  generality,  we  may  assume  in  this  section  that  dG  \  V  =  U. 
Recall  the  definition  of  X  given  in  (8)  and  for  each  5  >  0,  let 

(44) 

(  X(y)  C  X(x)  for  all  y  £  Bflx)  Cl  dG  and  3  n  £  n(x)  1 

Us  =  <  x  £  U  :  such  that  n  =  Y.iei{x)  0inl(x),  where  9i  >  0,  i  £  X(x),  l  , 
l  J2iei(x)  =  1-  and  (n>  d)  >  (5|d|  for  all  d  £  d(x)  J 

and  for  each  J  C  X,  J  /  0,  let 

(45)  Uf  =  {xeUs  :  X(x)  =  J}. 

It  is  immediate  from  the  definition  that  any  two  elements  in  {Uf ,  J  C 
X,  J  /  0}  are  disjoint,  and 


Us  =  |J  Uf,  U=\JUS. 

5>  0 


(46) 
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In  light  of  (46),  to  prove  (43)  and  hence  Proposition  6.1,  it  is  clearly  sufficient 
to  show  that  for  every  x  £  G,  5  >  0  and  J  C  X,  J  /  0,  such  that  U f  /  0, 

‘  /»oo 

(47)  E<**  /  luAu{s))ds 

Uo  5 

Indeed,  taking  hrst  the  sum  in  (47)  over  J  C  X,  J  ^  0,  next  the  limit  as 
5  -A  0  in  (47)  and  then  applying  Fatou’s  lemma,  we  obtain  (43). 

6.2.  Supporting  Results.  We  now  state  some  preliminary  results  that  will 
be  used  in  the  proof  of  Proposition  6.1.  Throughout,  we  assume  (G,  d(-))  is  a 
piecewise  C 2  domain  with  continuous  reflection.  We  start  with  an  elementary 
observation,  whose  proof  we  include  for  completeness. 

Lemma  6.2.  For  each  5  >  0  and  J  Cl,  J  ^  0,  Uf  is  closed. 

Proof.  Fix  5  >  0  and  J  C  X,  J  /  0,  such  that  Uf  /  0,  and  let  a 
point  x  £  and  the  sequence  Q  Uf  be  such  that  Xk  — >  x  as 

k  — >  oo.  Clearly,  x  €  d G  because  C  dG  and  d G  is  closed.  Let 

N\  <  oo  be  such  that  for  all  k  >  N±,  x  £  B^(xk)  H  dG.  Then  for  k  >  N\,  it 
follows  from  (44)  and  (45)  that  X(x')  C  X(x^)  =  J .  When  combined  with  the 
upper-semicontinuity  of  the  set-function  X(-),  this  implies  that  X(x)  =  J . 
Moreover,  given  any  y  £  Bs(x)  H  dG,  since  Bs(x)  is  open  and  Xk  -A  x  as 
k  — >  oo,  there  exists  N2  >  N\  such  that  y  £  B$(xk)r\dG  for  all  k  >  N2.  Since 
Xk  G  Uf ,  this  implies  that  X(y)  C  X(xk)  =  J  =  X(x).  Finally,  x'fc  £  Uf  also 
implies  that  there  exists  £  n(xk)  such  that  (nk,  d)  >  5|d|  for  all  d  £  d(xk)- 
Since  n*(-)  and  7*(-),  *  £  77,  are  continuous,  and  Xk  — >  x  as  k  — >  00,  and 
X(x)  =  X(xfc)  =  J ,  it  follows  from  the  dehnitions  of  n(x)  in  (9)  and  d(x) 
in  (10)  and  the  continuity  of  the  vector  fields  -f  ,i  £  X(x),  that  there  exists 
n  £  n(x)  such  that  (n,d)  >  5\d\  for  every  d  £  d(x).  Thus,  we  have  shown 
that  x  £  Uf ,  and  hence,  that  Uf  is  closed.  □ 


In  the  next  lemma,  we  construct  a  family  of  test  functions  that  he  in  the 
set  7~L.  The  proof  of  the  lemma  is  purely  analytic  and  hence,  is  relegated  to 
Appendix  B.  Some  properties  of  the  test  functions  are  stated  in  terms  of 
another  class  of  functions,  which  we  now  define.  Recall  that  <\>l ,  i  £  X,  are 
the  functions  that  characterize  the  domains  G{,  as  dehned  in  Definition  3.3. 
For  x  £  U,  let  0t(x)  >  0,  i  £  X(x),  be  constants  such  that  for  each  j  £  X(x), 


V</>*(x) 

IWM 


>  0. 


(48) 
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Such  constants  exist  by  the  definition  (6)  of  U.  Then,  for  x  G  U,  define 


(49) 


9*(»)=  E 

i£T(x) 


0j{x) 

|V^(s)| 


<F(.y),  y  g 


Lemma  6.3.  There  exists  a  function  k  :  (0,1)  i-a  (0,1/2)  with  n(s)  < 
e/2  for  every  e  G  (0,1)  such  that  for  each  x  G  U,  there  exist  constants 
0  <  r'x  <  rx  <  dist(x,  V),  0  <  cx  <  oo,  (3X  >  0,  and  a  family  of  functions 
{qe,x  £  TL  :  e  G  (0, 1)}  that  has  the  following  properties: 

1.  supp[ge>a;]  OGcGn  Brx(x); 

2.  -e2  -  e3/2  <  qStX  <  0; 

3.  |V(/£ja;|  X:  CX£ ?* 

4-  for  every  y  G  G  Cl  Bpx  (x), 


J 

E 


aij(y) 


d2qe,x 

dxidxj 


(y)  > 


“2cvf3x  cxe 
- Cx£ 


if  0  <  gx(y)  <  e/2, 
ife/ 2  <  gx(y)  <  e  -  k(s), 


and 


J 

J2  M y ) 

*j=i 


d2qe,x 

dx^Xj 


(y) 


<  CxVe 


if  gx(y)  >  e-  /e(e). 


For  each  <5  >  0  and  G  ^5,  let  rj.  be  the  constant  from  Lemma  6.3.  The 
neighbourhoods  {Bp  (x)  :  x  G  Us}  form  an  open  cover  of  the  closed  set 
Us .  The  next  lemma  shows  that  we  can  choose  a  countable  open  sub-cover 
that  has  certain  properties.  For  each  nonempty  subset  J  of  X,  recall  the 
definition  of  Uf  given  in  (45). 

Lemma  6.4.  For  each  5  >  0  and  J  C  X,  J  ^  0,  there  exists  a  countable 
set  of  points  Sf  C  Uf  such  that 

M's  ^  UxeS/-®d;(T), 

and  there  exists  a  measurable  mapping  nf  from  U 'f  onto  Sf  such  that  x  G 
Bp  (nf  (x))  and  X(x)  =  T(nf  ( x ))  for  each  x  G  Uf . 

Proof.  Fix  5  >  0,  x  G  U.  Let  r'x  >  0  be  the  constant  from  Lemma  6.3  and 
pick  J  CX,X/0  such  that  Uf  /  0.  Then  Uf  is  a  closed  set  by  Lemma  6.2, 
and  so  Uf  nPn(0)  is  compact  for  each  n  G  N.  Since  {Bpx  (x),  x  G  Uf  ni?n(0)} 
is  a  covering  of  the  compact  set  Uf  n  Bn(0).  there  exists  a  finite  subset  S^s 
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of  U f  n  Bn( 0)  such  that  {Br/x(x),  x  G  Sfs}  covers  Uf  n  Bn( 0).  It  is  clear 
that  the  countable  set  Sf  =  U n£^Sfs  satisfies  the  stated  property.  We  can 
further  choose  the  set  Sf  to  be  minimal  in  the  sense  that  for  each  strict 
subset  C  of  Sf,  U xecBr1  (x)  does  not  cover  Uf .  Denote  Sf  =  { Xk ,  k  G  N}. 
Let  Dk  =  Bri  (xk)  \  (ufb!  Br>  (xD)  PlW/  for  each  k  G  N.  Then  { D &,  k  G  N} 

is  a  partition  of  Uf ,  and  so  for  each  x  G  Uf  there  is  a  unique  index  k{x)  such 
that  x  G  Dyxy  Define  k^(x)  =  xmx\.  Then  k ^  is  a  measurable  mapping 
from  Uf  onto  Sf  that  satisfies  the  stated  property.  □ 

6.3.  Proof  of  Proposition  6.1.  We  first  introduce  a  sequence  of  stopping 
times.  Fix  5  >  0  and  J  C  X,  J  /  0,  such  that  U f  /  0.  Let  Sf,  {Br^(x)  : 
x  G  Sf }  and  the  measurable  mapping  nf  be  as  in  Lemma  6.4.  Now,  set 
do  =  0  and  for  n  G  N,  recursively  define 

(50)  Tn  =  inf{t  >  crn_i  :  u(t)  G  Uf}, 

(51)  an  =  inf  j  t  >  rn  :  u(t)  <£  Br ,  (nf  (w(rn))) 

Since  £7^"  is  a  closed  set  by  Lemma  6.2  and  (nf  (w(rn)))  is  an  TV„- 

Kf[  (w (Tn)) 

measurable  open  ball,  {rn,  n  G  N}  and  {<rn,  nGNU  {0}}  are  two  nested 
sequences  of  stopping  times. 

Now,  fix  x  G  G  and  let  be  the  solution  to  the  well-posed  submartingale 
problem  associated  with  (G,  g?(-)),V,  b(  )  and  cr(-).  From  the  discussion  in 
Section  6.1,  it  suffices  to  establish  (47),  for  which  we  will  use  a  proof  by 
induction.  Note  that  for  n  =  1,  <rn_  i  =  0  and  so  we  trivially  have 


(52) 


Now,  suppose  that  (52)  holds  for  some  n  G  N.  We  will  show  that  then 
(52)  also  holds  with  n  replaced  by  n  +  1.  Since  under  (Q)x,  u>(t)  fL  Uf  for 
t  G  [<7n_i,rn),  it  is  clear  that 


Next,  for  each  y  G  U,  let  the  constant  cy  G  (0,  oo)  and  the  family  of  test 
functions  qe.y,  e  G  (0, 1),  be  as  specified  in  Lemma  6.3.  Since  q£<y  G  Pi,  q£,y 
is  constant  in  a  neighborhood  of  V  and  (d,  \/q£)V(z))  >  0  for  all  d  G  d(z)  and 
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z  £  dG ,  by  property  3  of  Definition  2.1  and  the  optional  stopping  theorem, 
for  each  y  E  ZL  and  e  £  (0, 1), 

ftA(J„ 

q£,y(u}(t  A  an))  -  £q£,y(uj(u))  du 

Jo 

is  a  Q.x-submartingale.  In  fact,  the  above  submartingale  is  integrable  because 
q£jy  £  U  implies  q£.y  is  uniformly  bounded.  Now,  let  (e*.,  k  £  N}  be  a 
sequence  of  real  numbers  in  (0, 1)  such  that  £k  — >  0  as  k  — >  oo.  The  same 
argument  that  is  used  in  the  proof  of  Theorem  1.2.10  of  [44]  can  be  applied 
to  show  that  for  the  regular  conditional  probability  distribution  {Qw,ca  £ 

C[0,  oo)}  of  Qx  given  A4T„,  there  exists  a  Q^-null  set  F  £  MTn  such  that  for 
each  oj  ^  F,  y  £  Sf  and  £k ,  k  £  N, 

(54) 

/•tA<Tn(u/) 

qEk,y(uj'(t  A  CTn(u/)))  -  q£ktV(uJ,(t  A  Tn{J)))  -  /  Cq£k,y{d (u))  du ,  t  >  0 

</  tAT„(oj') 


is  a  Q^-submartingale  and 
(55) 

Qw  ( oj '  £  C[0,oo)  :  th(uj ')  =  Tn(u)  and  u'(t)  =  w(f),  0  <  t  <  Tn{uj ))  =  1. 


Due  to  (52)  and  (53),  it  follows  that 
(56) 


ro-n 

l>(Tn(oj') 

= 

I{r„(W)<oo}IEQ“ 

/  W(w'(s))ds 

L-/0  15  J 

Jrn(oj) 

Consider  oj  ^  F  such  that  Tn{u)  <  oo.  Note  that  oj(rn{uj))  £  Uf .  Let  x  £  Sf 
be  such  that  x  =  nf  (w(rn( a;)))  and  recall  that  X(w(rn( a;)))  =  Z(x)  =  J7”.  Fix 
t  >  Tn((jj)  and  note  from  (55)  that  for  (QL,  almost  surely  every  u/,  t  >  Tn{ui')  = 
Tn{uj).  Since,  under  lo'(s)  £  G  Cl  Br>_(x)  for  every  s  £  [rn(cj),  cq^u/)),  it 
follows  from  the  submartingale  property  of  (54)  and  property  (2)  of  q£ktx  hi 
Lemma  6.3  that 


rtAcrn  (oj') 

/  Tn  (  OJ  ) 


jCq£ktx(u' (u))  du 


<  1Eq“  [q£k^(u\t  A  crn(u/)))  -  ^^'(mM))] 

<24  +  2ef . 
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On  the  other  hand,  note  that 


'  T„(w) 


£qek,x{w' {u))  du 


f'tAcrn (u/)  ^ 


'  Tn(u)) 


A  ("»  g^ax.  du 


i,j=l 


,^')J  9qti}l(u'(u)) 


I  Tn  (o;) 


^2bj(u'(u)) 


3= 1 


3x,- 


du 


Combining  the  last  two  displays  with  property  (3)  of  q£k,x  in  Lemma  6.3, 
we  have 


rt/\crn{<jj')  J 

'T«M  i,j= l 
-2  ,  ^3/2 


T,  ^  in 


<A£%  +  A£k'  +2cst  sup  \b(z)\ek. 

z£Gf)B  /_ 

X 

Together  with  property  (4)  of  qEk,x  in  Lemma  6.3,  this  implies  that 

/•iA<r„(u/) 


(2 a/3x  -  Cx 


'Tn(cj) 


I{0 <gx(u'(u))<£k/2}  du 


<  Cxty/£k  +  Cxt£k  +  4e£  +  4e^/2  +  2cst  sup  \b(z)\ek. 

zeGrB , 


Letting  first  k  -A  oo  and  then  t  -A  oo,  we  obtain 

rcr„(ui') 


l{gx(u/(u))=0}  du 


=  0. 


From  the  definition  of  an  and  given  in  (51)  and  (49),  respectively,  it 
follows  that 


rtAa„(u>') 


In  j€JdGj{u'(u))du 


rt/\<Jn(u') 

I  Tn  {cj) 

rtAan(uj') 
'  Tn(tJj) 


Ini6l(e)aGi(w,(«))rf« 


^{gx(u/(ti))=0} 
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Thus,  it  follows  that 

r<rn{u')  rcrn(u /) 

I  lUj{J{u))du  <  Eq“  /  In.ejdGj(u'(u))du  =0. 

Tn(w)  5  JT„(w) 

When  combined  with  (56),  this  shows  that  (52)  holds  with  n  replaced  by 
n  +  1.  Since  an(uj)  — >  oo  as  n  — >  oo  for  Qa,  almost  every  co,  the  proposition 
follows  by  induction. 

7.  Proof  of  Theorem  2.  The  proof  of  Theorem  2  relies  on  the  con¬ 
struction  of  certain  local  test  functions,  whose  existence  we  first  establish. 

Proposition  7.1.  For  each  x  G  G,  there  exist  a  constant  rx  >  0,  in¬ 
creasing  continuous  functions  ax  :  (0,  rx )  i-a  (0,  oo)  and  kx  :  (0,  rx )  i-a  (0,  oo) 
such  that  kx  <  ax,  linv^o  ax (r)  =  0,  and  a  collection  of  nonnegative  func¬ 
tions  {gx,r  £  Cc(G),r  G  (0,^)}  that  satisfy  the  following  properties: 

1.  supp[gX)r}  n  G  C  Bax{r){x)  n  G; 

i ■  gx,r  c  H : 

3.  0  <  gXtr(y)  <  1  for  y  G  RJ  and  gx,r{y)  =  1  for  each  y  G  BKx^(x)  Cl  G. 
Moreover,  if  x  G  8G  \  V ,  we  can  choose  ax(r)  =  r  for  r  G  (0,  rx). 

Proof.  We  split  the  proof  into  two  cases,  depending  on  whether  x  lies 
in  the  interior  or  the  boundary  of  G. 

Case  1:  x  G  G.  Let  f  be  a  bounded  C°°  function  on  M  such  that  £(z)  =  1 
when  z  <  1/2,  £(z)  =  0  when  z  >  1,  and  £  is  strictly  decreasing  in  the 
interval  (1/2,1).  Note  that  then  |j£/||oo  <  oo  and  H^Hoo  <  oo.  For  each 
x  G  G  and  0  <  r  <  (dist(x,  OG))2,  define  gx,r{y)  =  £(|y  —  x\2/r)  for  y  G  MJ. 
We  now  verify  that  gX)T  satisfies  properties  (l)-(3)  of  the  proposition,  with 
rx  =  dist(x,  dG))2 ,  ax(r )  =  \fr  and  Kx(r)  =  y/r/2.  The  first  property  holds 
because  \x  —  y\2/r  >  1  when  y  0  B ^(x)  and  £(z)  =  0  when  z  >  1.  The  third 
property  is  satisfied  because  0  <  f(z)  <  1  for  z  G  M  and  y  G  B v^/2(*x)  implies 
(y  —  x)2 /r  <1/4,  and  f(z)  =  1  for  z  <  1/4.  It  is  clear  that  gX)T  G  C2(G)  and 
supp[<7x,r]  FI  G.  Hence,  —gx,r  G  Fi.  This  completes  the  proof  of  Case  1. 

Case  2:  x  G  dG.  Fix  x  G  dG.  If  x  G  V,  recall  vx  and  px>  0  from  Assumption 
2.  If  x  V,  recall  (48)  and  let  vx  =  Y2iez(x)  @i(x)  |v^‘(^)|  •  Without  loss  of 
generality,  we  may  assume  that  Yhiei(x)  @i(x)  e  (O’  !]•  Thus,  we  have  | |  <  1 
in  both  cases.  In  addition,  since  V  is  a  finite  set,  if  x  G  V,  we  may  assume, 
without  loss  of  generality,  that  V  n  BPx(x)  =  {x}.  In  this  case,  we  will  show 
that  Proposition  7.1  is  satisfied  for  some  rx  <  fx,  ax(r)  =  r  and  nx(r)  =  r/8, 


45 


42  W.  N.  KANG  AND  K.  RAMANAN 

where 

-  .  f  dist  (x,  V  U  U n£z(x)  ( dG  n  Gi)  if  x  V, 

rx  \  Px  if  X  £  V. 

It  follows  from  Assumption  2,  (48)  and  the  continuity  of  j  £  Z,  that 

there  exists  rx  <  rx  A  pj  such  that  (vx,  d)  >  0  for  each  d  £  d(y)  n  S]  (0)  and 
y  £  Brx{x).  For  each  r  £  ( 0 . rx ) ,  consider  the  following  function  fr  defined 
on  by: 


{—  (vx,  y  —  x)  +  7r/8  if  r/4  <  \y  —  x\  <  7r/8, 

1  if  \y  ~  x\  <  r/4, 

0  if  \y  —  x\  >  7r/8. 

Since  \vx\  <  1  and  r  <  rx  <  8/14,  when  r/4  <  \y  —  x\  <  7r/8,  we  have 

—  (vx,  y  —  x)  +  7r/8  <  | y  —  x\  +  7r/8  <  7r/8  +  7r/8  =  14r/8  <  1 

and 

—  (vx,  y  —  x)  +  7r/8  >  —  \y  —  x\  +  7r/8  >  0. 

Clearly,  (1  <  fr  <  1 .  Let  {(pm  £  £  N}  be  a  sequence  of  non¬ 

negative  functions,  where  each  (f>m  satisfies  fRj  (pm(x)  dx  =  1  and  has  com¬ 
pact  support  in  BCm( 0)  and  {cm,m  £  N}  is  a  sequence  such  that  cm  — >  0  as 
m  — >  oo.  For  each  r  £  (0,  rx),  choose  mr  £  N  such  that  cmr  <  r/8.  Define 


9x, r  —  fr  *  (prrir  > 


where  *  denotes  the  convolution  operation.  Then  it  is  clear  that  gx  r  £ 
C/°(MJ),  0  <  gx,r  <  1,  gXtr(y)  =  1  for  each  y  £  Br/8(x),  and  supper]  C 
Br(x).  This  shows  that  properties  (1)  and  (3)  hold.  To  show  that  —gXjT  £  77, 
note  that  fr  is  locally  integrable  and  so  has  a  distributional  derivative  V/r, 
which  is  given  explicitly  by 


V/r(y) 


— vx  if  r/4  <  \y  —  x\  <  7r/8, 

0  otherwise. 


Thus,  S/gx^r  =  V fr  *  4)mr  and  S7gx<r(y)  =  vx  for  each  y  such  that  3r/8  < 
\y  —  x\  <  3r/4.  It  is  clear  that  (d,  \7  fr(y))  <  0  for  each  y  £  dG  and  d  £  d(y). 
This  implies  that  —  gXtT  £  7~L.  □ 


REMARK  7.2.  From  the  proof  note  that  for  x  £  G,  the  function  gx  r 
constructed  above  is  translation  invariant  in  G  in  the  sense  that  for  z  £  G—x, 
9x,r(y)  =  9x+z,r{y  +  z)  for  each  y  e  B^(x)  and  r  <  min (rx,rx+z). 
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We  now  turn  to  the  proof  of  Theorem  2. 

Proof  of  Theorem  2.  Suppose  that  (G,d(-))  is  piecewise  C1  with  con¬ 
tinuous  reflection  and  Assumption  2  holds.  We  first  show  that  77  satisfies 
property  1  of  Assumption  1.  Let  x,y  G  G  with  x  /  y.  Let  rx  and  ax{-)  be  as 
in  Proposition  7.1,  choose  r  <rx  sufficiently  small  such  that  ax(r )  <  \x  —  y\ 
and  let  gX}T  be  the  function  in  Proposition  7.1.  Then,  gx  r  takes  the  value  0 
at  y  by  property  (1)  and  it  takes  the  value  1  at  x  by  property  (3).  Thus,  the 
function  —  gx^r  G  77  separates  x  and  y. 

We  now  establish  property  2  of  Assumption  1.  Since  (i(-)nS'i(O)  in  (10)  is 
continuous  for  piecewise  C1  domains  with  continuous  reflection,  by  Remark 
3.2  it  suffices  to  show  that  for  every  x  G  dG  \  V  there  exists  /  G  77  such 
that  (d,  V/(x))  >  0  for  every  d  G  d(x)  n  S'i  (0).  By  (6),  there  exists  n  G  n(x) 
such  that  (d,n)  >  0  for  every  d  G  d(x)  \  {0}.  Choose  gx.r  as  in  Proposition 
7.1  for  some  r  G  (0,  rx)  and  define 

f(y)  =  9x,r(y){C1  + (n,y)),  yeG, 

where  C\  is  selected  so  that  C\  +  (n,y)  <  0  on  supp[gXjT ].  Then  for  each 
y  G  dG  and  d  G  d(y), 

(d,Vf{y))  =  {Ci  +  ( n,y)){d,VgX!r(y ))  +  gx,r(y)(d,  n)  >  0. 

Thus,  /  G  H.  Moreover,  by  property  (3)  of  gXj1.  in  Proposition  7.1,  we  have 
that  gx,r{x )  =  1  and  \7gx,r(x)  =  0.  This  implies  that 

inf  (d,'Vf(x))=  inf  (d,  n)  >  0. 
d£rf(o:)nSi(0)  d£d(a;)nSi(0) 

This  establishes  property  2  of  Assumption  1.  The  second  part  of  the  theorem 
follows  directly  from  the  boundary  property  stated  in  Proposition  6.1  and 
the  stationarity  of  n.  □ 


Acknowledgments.  The  authors  are  grateful  for  comments  by  an  anony¬ 
mous  reviewer  that  led  to  an  alternative,  more  compact  proof  of  Theorem 
1  than  the  Markov  chain  construction  that  was  used  in  an  earlier  version  of 
the  paper  [27] . 

APPENDIX  A:  AN  APPROXIMATION  LEMMA 

In  this  section,  we  prove  the  approximation  result  stated  in  Lemma  5.3. 
Let  Q  be  the  set  of  rational  numbers  in  M  and  for  sGl,  let  Qs  be  the  subset 
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of  rational  numbers  less  than  s.  Since  V  =  {iq,  •  •  •  ,  vk\  is  at  most  finite,  let 
Qy  =  {r  E  QJ  :  V  C  Br(0)}.  For  each  s  E  Q,  let  B(V,  s )  denote  the  set 

B(V,  s)  =  {x  E  MJ  :  dist(x,  V)  <  s}. 


Then  there  exists  so  >  0  such  that  for  every  r  E  QSo,  B(V,s )  is  a  disjoint 
union  of  {Bs(vi)  :  l  =  1,  ■  ■  ■  ,I\}.  For  each  r  E  Qy  and  rational  number 
s  <  so,  it  follows  from  property  2  of  Assumption  1  that  there  exists  a 
function  hrjS  E  %  H  Cj?(G)  such  that 
(57) 

(d,Vhr,s(x))  >  1  for  all  d  E  d(x)  H  S'i(O)  and  x  E  [dG  n  -Br(0)]  \  B(V,  s ). 


Recall  that  {<j)m  E  C^°(MJ),m.  E  N}  is  a  sequence  of  non- negative  functions, 
where  each  (f>m  satisfies  fRj  4>m(x)  dx  =  1  and  has  compact  support  in  -BCm(0) 
and  {cm,  m  E  N}  is  a  sequence  such  that  cm  — >  0  as  m  — >  oo.  Also,  let  L  be 
the  countable  set  of  all  polynomials  with  rational  coefficients.  Now,  given 
any  m  E  N  and  w  =  (r,  s,  {ag,  i  =  1, . . . ,  K})  E  Qy  x  QS(I  x  Qh ,  we  define 
the  mappings  Sw  :  La  Mk'7  and  SWjTn  :  L  i-A  C°°(MJ)  as  follows:  given  any 
polynomial  q  E  L, 

(  q(x)  if  x  E  (G  n  Br(0))  \  B(V,  s), 

(Swq)(x)  =  <  0  if  x  E  (Gfl  Br( 0))c, 

{  ai  if  x  E  Bs(vi),l  =  1,  •  •  • ,  K, 


and 


( Sw,mQ )  —  *  <pn 


Then  clearly,  (Swq)  is  a  function  on  and  {SW)mq)  E  C°°(MJ).  Fixing 
w  =  (r,  s,  {a^,  7  =  1, . .  . ,  K})  as  above,  without  loss  of  generality,  by  taking 
m  large  enough  so  that  cm  <  min{dist(Rs(^),  Bs(vj)),j,£  E  {1 ,K},j  / 
£}/2  we  can  guarantee  that  for  each  £  =  1, . . . ,  K,  SWtTnq{x )  =  ag  in  an  open 
neighborhood  of  vg  and  (VSWtmq)(x)  =  0  for  every  x  0  G  n  Br+Cm( 0).  Now 
define  Ho  by 


Ho  — 


Nfiviri  q  T 

q  E  L,  w 


[sup3,e9GnBr+cm(0)  supded(;r)n5l(0)  (d,  VSw,mq) 
=  (r,  s,  {ag})  E  Qy  x  QSo  x  Q^,  mEN.kQ 


hr,s  T  ^ 


It  is  easy  to  see  that  Ho  is  a  countable  subset  of  H. 

We  now  show  that  Ho  has  the  required  property.  Fix  an  /  E  H.  Without 
loss  of  generality,  we  may  assume  that  /  E  C^(G).  Fix  Bjy(0)  containing 
an  open  neighborhood  of  V  and  an  open  neighborhood  of  supp(/).  For  any 
function  h  E  C2(MJ),  we  define  the  norm 

IWIc2(GnBjv(0))  =  sup  max{|JD/3/(x)|  :  |/3|  <  2}, 
x£GCBn(0) 
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where  D13  f(x)  is  the  partial  derivative  corresponding  to  the  multi-index  (3. 
Given  e  >  0,  by  Theorem  1  of  [2],  there  exists  a  sequence  of  polynomials 
{q^  :  k  £  N}  in  L  and  ko  >  0  such  that  for  any  k  >  ko, 

(58)  \\f  ~  Q^\\c2(GnBN(o))  ^ 

For  each  £  =  1, . . . ,  K,  choose  at  £  Q  such  that  |  f(yt)  —  at\  <  e/4,  choose 
s  £  QSo,  r  £  Q,  r  <  N  such  that  Br( 0)  contains  both  an  open  neighborhood 
of  V  and  an  open  neighborhood  of  supp(/),  and  set  w  =  (r,  s,{a£}).  For 
k  £  N,  define  qffl  =  Swq ^  and  qw)n  =  SWtmq^k\  Then  for  each  x  £  MJ,  for 
io  =  (r,  s,  {at}), 

(  q^k\x)  —  f{x)  if  x  £  (G  Cl  Br(0))  \  B(V,  s), 

Qw\x)  ~  f(x)  =  l  0  if  x  G  (Gn  -Br(0))c, 

{  ai-  f(x)  if  x  £  Bs(vi),  l  =  1,  •  •  •  K. 

Thus,  for  each  k  >  ko, 

sup  |  q^\x)  -  f(x)  |  <  e/4. 
xeRJ 

It  follows  that  for  each  x  £  G  Cl  Bjy( 0)  and  k  >  ko, 

I  q£L(x)  -  Qk(x)\  <  I  (Qw\x)  -  f)  *  <pm(x)  |  +  |  f*  (t>m{x)  -  f{x)  |  +  |  f{x)  -  <?(fc)(x)| 

<  e/2  +  | (f*</>m){x)  -  f(x) \. 

Since  the  convolution  operation  commutes  with  differentiation,  analogous 
arguments  can  be  used  to  show  that  the  above  holds  with  q^ln ,  q^k\  qff 
and  /  replaced  by  D^q^ln.,  D^q^k\  D^qffl  and  D0/,  respectively,  for  any 
multi-index  (3  =  (f3\, . . . ,  f3j).  So,  in  particular, 

II -  Q{k)\\c2(GnBN(0))  <  SUP  II /(*)  -  f*  Hx)\\c2(GnBN(o))  +  A- 

x&C2(GCBn(0))  Z 

On  the  other  hand,  since  /  is  bounded  and  uniformly  continuous,  —• >  f 

uniformly  as  m  — >  oo.  Thus,  for  each  k  >  ko,  we  can  choose  nik  large  enough 
such  that  r  +  cmfc  <  N  and 

1 1 ~(fc)  (fc) ii  .  3e 

II Qw,mk  ~  <1  llc2(GnBjv(0))  ^  -£■ 


Combining  this  with  (58),  we  have  that  for  each  k  >  ko, 

(59)  II Vw}mk  -  f\\c2(GrBN(0))  ^  £- 
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In  addition,  from  (59)  for  each  x  G  G  n  -Bjv(O)  and  d  G  d(x)  O  <Si(0), 
(d,  V/(x))  >  0,  we  have  Vgwjnfc(x)^  <  e.  For  each  k  >  ko ,  let 

(60)  =  sup  sup  (d,Vq$mk{y))  hr>s. 

yedGnBr+Cmk(o)ded(y),\d\=i''  1 

Then  gk  G  "Ho  for  each  k  >  ko  and  :  k  >  ko}  satisfies  (36). 

For  the  second  part  of  the  lemma,  let  "Do  =  {/+sup,yeRj  f~(y)  ■  f  G  "Ho}- 
Then  Po  is  a  countable  subset  of  P.  For  each  /  G  P,  by  the  first  part  of  the 
lemma,  there  exists  a  sequence  { g k  :  k  G  N}  C  "Ho  such  that  (36)  holds, 
where  g k  is  given  by  (60).  For  each  k  G  N,  let  pk  =  gk+supy£^j  g^(y).  Then, 
the  sequence  {pk  :  k  £  N}  C  P0.  Since  /  >  0,  sup.yegnBAr(0)  g^  (y)  ->  0  as 
k  — >  oo.  For  each  x  ^  G  H  -Bat(O)  and  w  =  (r,  s,  {a^}),  we  have  q!^  m,  (x)  =  0 
and  hence 

9k(x)=  SUP  SUP  (d>Vg£m  (j/)\  hr,s(x)~. 

yedGnBr+Cmk  (0)  ded(y),|d|=l  N  1 


So  it  follows  that 

lim  sup  (x) 
fc_K3OxgGn.Bjv'(0) 

=  lim  sup  sup  {d,Vq*  (y))  sup  hr)S(x)~ 

k^oo  yeaGnBr+Crnk(0)  d£d(y),\d\  =  l  X  '  x£GCBn(0) 

=  0. 

Thus,  {pk  :  k  >  /co}  satisfies  (36)  with  P  in  place  of  H  and  Po  in  place  of 
"Ho-  This  completes  the  proof  of  the  second  part  of  the  lemma. 

APPENDIX  B:  CONSTRUCTION  OF  TEST  FUNCTIONS 

In  this  section,  we  prove  the  existence  of  test  functions  with  properties  as 
stated  in  Lemma  6.3.  Fix  xGliC  dG  \  V  and  £  G  (0, 1).  The  test  function 
q£jX  will  be  defined  in  terms  of  the  function  de  on  (—00,00)  given  by 

(  s2  if  0  <  s  <  s, 

d£(s )  =  <  e2  +  £3/2  -  y/e(e  +  y/s  —  s)2  if  £  <  s  <  e  +  y/s, 

\  £2  +  £3//2  if  £  +  yfe  <  s, 


and 


de(s)  =  d£(—s)  if  s  <  0. 
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We  first  summarize  the  properties  of  d£  that  we  will  require.  It  is  easy  to 
verify  that 

0  <  d£(s)  <  e2  +  e3/2,  for  s  G  (— oo,  oo), 

(61)  0  <  d'£(s)  <  2s,  for  s  G  [0,  oo), 

d'e(s)  =  0,  for  s  >  s  +  yfs. 

Also,  note  that  d£  G  C1(M)  and  d!e  is  piecewise  differentiable  with  the  second 
derivative 

(2  if  0  <  s  <  s, 

d”(s)  =  <  —2 sfs  if  £  <  S  <  £  +  y/~£, 

\  0  if  £  +  yfs  <  S. 

We  now  use  a  standard  mollification  argument  to  construct  a  C 2  (M)  func¬ 
tion  with  similar  properties.  Let  {< f>n  G  C^°(M),n  G  N}  be  a  sequence  of 

non- negative  functions  with  fR<f>n(x)  dx  =  1  and  compact  supports  that 

shrink  to  {0}.  Define 

d  £  =  <t>n  *  d£  , 

where  *  denotes  the  convolution  operation.  Then  d£  —  £2  —  e3^2  G  C^°(M) 
and  for  n  sufficiently  large,  there  exist  Kn(s)  >  0  with  lim^oo  Kn(£)  =  0 
such  that 

0  <  d£(s)  <  £2  +  e3/2  if  s  G  (—00,00), 
d£(s)  =  £2  +  e3/2  if  s  >  2  (e  +  y/i), 

0  <  (d£)'(s)  <  2e  if  s  G  (—00,00), 

(62)  (<£)"(«)  =  2  if  0  <  s  <  e/2, 

(■ d£)"(s )  >0  if0<s<£  —  Kn(s), 

\(d%y'(s)\  <2y/£  if  S>£~Kn(£), 

{dne)"{s)  =  0  if  s  >  2(e  +  y/e). 

Now,  for  the  chosen  x  G  dG  \  V,  let  rx  and  r'x  =  Kx{rx)  be  the  two 
constants  in  Proposition  7.1,  let  gx,rx  be  the  associated  function  and  recall 
from  Proposition  7.1  that  we  can  assume  the  function  ax  satisfies  ax(r)  =  r. 
Also,  let  gx  be  the  function  defined  in  (49),  with  the  associated  9i(x),i  G 
I(x).  Choose  n  sufficiently  large  so  that  (62)  holds  and  for  each  y  G  RJ,  let 

Pe,x(y)  =  de(9x{y))  and  q£,x(y)  =  ( Ps,x{v )  -  e2  -  £3/2)9x,rx(y)- 

It  follows  from  the  properties  of  gXj1-x  and  (62)  that  q£:X  G  C2(G),  G  Cl 
suppfe,*]  C  GnBrx(x),  -s2  -  e3/2  <  q£tX  <  0,  and 

(63)  qs,x(y)  =  Pe,x (y )  -  £2  -  e3/2 ,  y  G  G  n  Br>x  (,x) . 
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An  elementary  calculation  shows  that  for  y  £  , 

(64)  Vq£,x(y)  =  V Pe,x(y)9x,rx{y )  +  (PeAv)  -  e2  -  £3/2)V 9x,rx(y)i 

where 


(65) 


Vp«(»)  =  «)V(t/))  E  wAf^- 

i€.T(x) 


Since  (d£)'  >  0  by  (62),  Oi(x )  >  0  and  V</>*  is  proportional  to  nl,  it  follows 
that  {d,Vpe>x(y))  >  0  for  each  d  £  d(y)  and  y  £  U.  When  combined  with 
the  facts  that  the  function  gx,rx  is  nonnegative,  the  function  p£jX  —  e2  — 
e3/2  nonpositive  and  —gx,rx  lies  in  "H,  this  implies  that  (d,’Vq£jX(y))  > 
0  for  each  d  £  d(y)  and  y  €.U.  Thus,  q£.x  £  H. 

Next,  note  that  V<j>1  is  bounded  on  the  support  of  gx.rx ,  0  <  gx,rx  <  1 
by  property  (3)  of  Proposition  7.1  and  d'£(s)  £  [0,  2e]  by  (61),  it  follows 
that  there  exists  cx  <  oo  such  that  \^/ps,x(y)9x,rx(y)\  <  cxe  for  all  y  £  MJ. 
On  the  other  hand,  since  gx,rx  £  Cj?(G),  VgXjrx  is  bounded  (say  by  Mx), 
and  it  follows  that  |  \Pe,xVgx  rx  ||oo  <  Mxe 2  <  Mxe  if  e  <  1.  This  implies 
that  HV^Hoo  <  axe  for  some  ax  <  oo.  Moreover,  due  to  (63),  for  every 
y  £  Gn5r-(i), 


i,3= 1 


=  (<C)"(«’(!/))(V9'(l/),a(»)V9*(I/)) 


AOVM)  E  ««(») 

*d=i 


Q2gX 

dxndx . 


iy)- 


By  the  fourth  property  in  (62),  the  second  property  in  (61),  the  uniform 
ellipticity  of  a  and  the  bound  on  the  second  derivatives  of  gx  on  Br'x  (x),  by 
redefining  cx  to  be  larger  if  necessary,  we  deduce  that  if  0  <  gx{y)  <  e/2,  y  £ 
G  0  Br>x  (x) ,  then 


(66) 


J 

aAy) 

i,j=  1 


d2qeAy ) 

dxidxj 


> 


2a\Vgx(y)\  —  2e 


j 

aAy) 

i,j=  1 


d2gx{y) 

dxidxj 


:  Zafix  cx£, 


where  a  is  the  positive  constant  in  (12)  and  f3x  =  inf y^Gr\B  ,  (x)  \^9x(y)\  >  0- 
Moreover,  by  the  third  and  sixth  properties  in  (62),  it  is  clear  that,  by 
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choosing  cx  yet  larger  if  necessary,  for  each  y  €  G  Cl  Br*x  (x)  with  gx  (y)  > 
e  -  Kn(e), 


j 

i,j= 1 


d'2qsAy ) 

dxidxj 


<2^\(Vgx(y),a(y)Vgx(y))\  +  2e 


j 

°y(^) 

i,j= 1 


d2gx{y) 

dxidxj 


<  cxyfe. 


The  fifth  property  in  (62)  shows  that  when  y  £  Gfl  Brix(x)  and  e/2  < 
gx(y)  <  e  -  K„(e),  then 


/  \d2Qe,x(y)  ^  0 

2^  aij(y)~  - —  >  -2e 


*d=i 


dxidxj 


v-  ,  ^  d2gx{y ) 

^  ax,ax' 


*j=i 


\j  tXj  ^ 


>  — cre. 


This  completes  the  proof  of  the  lemma. 
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